-- Logs begin at Tue 2022-10-04 08:04:10 UTC, end at Tue 2022-10-04 09:01:37 UTC. -- Oct 04 08:31:53.008161 dv-cinder-860212-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 08:31:53.017507 dv-cinder-860212-1-smb devstack@keystone.service[88059]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:31:53 2022] *** Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: nodename: dv-cinder-860212-1-smb Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: machine: x86_64 Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: clock source: unix Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: pcre jit disabled Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: detected number of CPU cores: 4 Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: current working directory: / Oct 04 08:31:53.019536 dv-cinder-860212-1-smb devstack@keystone.service[88059]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: your processes number limit is 47680 Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: your memory page size is 4096 bytes Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: detected max file descriptor number: 2048 Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: lock engine: pthread robust mutexes Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: thunder lock: enabled Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 08:31:53.020063 dv-cinder-860212-1-smb devstack@keystone.service[88059]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:31:53.058957 dv-cinder-860212-1-smb devstack@keystone.service[88059]: Python main interpreter initialized at 0x5596128e39c0 Oct 04 08:31:53.058957 dv-cinder-860212-1-smb devstack@keystone.service[88059]: python threads support enabled Oct 04 08:31:53.058957 dv-cinder-860212-1-smb devstack@keystone.service[88059]: your server socket listen backlog is limited to 100 connections Oct 04 08:31:53.058957 dv-cinder-860212-1-smb devstack@keystone.service[88059]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:31:53.059346 dv-cinder-860212-1-smb devstack@keystone.service[88059]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:31:53.059346 dv-cinder-860212-1-smb devstack@keystone.service[88059]: *** Operational MODE: preforking *** Oct 04 08:31:53.059632 dv-cinder-860212-1-smb devstack@keystone.service[88059]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:31:53.059632 dv-cinder-860212-1-smb devstack@keystone.service[88059]: spawned uWSGI master process (pid: 88059) Oct 04 08:31:53.059838 dv-cinder-860212-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 08:31:53.060571 dv-cinder-860212-1-smb devstack@keystone.service[88059]: spawned uWSGI worker 1 (pid: 88071, cores: 1) Oct 04 08:31:53.060746 dv-cinder-860212-1-smb devstack@keystone.service[88059]: spawned uWSGI worker 2 (pid: 88072, cores: 1) Oct 04 08:31:53.062644 dv-cinder-860212-1-smb devstack@keystone.service[88059]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:31:57.346011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:57.346011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: from cryptography.utils import int_from_bytes Oct 04 08:31:57.346805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:57.346805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: from cryptography.utils import int_from_bytes Oct 04 08:31:57.349267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:57.349267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: from cryptography.utils import int_from_bytes Oct 04 08:31:57.349746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:57.349746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: from cryptography.utils import int_from_bytes Oct 04 08:31:57.396468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:31:57.396633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:31:57.396783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] command line args: [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:31:57.397075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:31:57.397231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ================================================================================ {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:31:57.397486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] admin_token = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.397728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] config_dir = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.397815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:31:57.397917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.398020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:31:57.398103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] config_source = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.398185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] command line args: [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:31:57.398264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] debug = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.398444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.398699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:31:57.398699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ================================================================================ {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:31:57.398822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.398882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] admin_token = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] config_dir = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] config_source = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] debug = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_config_append = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.399978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_dir = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_file = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.400977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_config_append = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_dir = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_file = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.401955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402520 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.402973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.403791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.404015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.404195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.404287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.404379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] publish_errors = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.405988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] publish_errors = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] standard_threads = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.406983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] use_journal = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] use_json = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] use_stderr = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] standard_threads = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] use_syslog = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.407944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.408304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] use_journal = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.408608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] use_json = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.408832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] use_stderr = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] use_syslog = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.408994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.409144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:57.409233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.409407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.409486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.409650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.409738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.409886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.410946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.411916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.412913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.413859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.414953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.415985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.416976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.417889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.418976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.419964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.420160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.420242 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.421967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.422894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.423000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.423130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.423361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.423607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.423828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.424855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.425988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.426933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427242 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427715 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.427958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.428940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.429873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.430980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.431986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.432907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.433862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.external = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.434960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.password = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] auth.token = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.435840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.external = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.436999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.password = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.437953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] auth.token = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.438911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.439929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.440961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.441909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.442867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.443982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.444968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.445986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.446937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.447883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.448881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.449956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.450990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.451964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.452936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.453955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.454970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.455928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.456891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.457869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.458980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459683 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.459929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.460941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.461882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.462987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.463937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.464995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.465954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.466914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.467594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.467677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.467851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.467939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] role.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.468931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] role.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.469885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.470857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] role.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] role.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.471966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.472959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.473927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.474973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.475887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.476888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.477983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.478941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.479961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.480968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.connection = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.481937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.482090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.482169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.482325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.482406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.482563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.482698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.483337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.483428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.483571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.483652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.483803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.484843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.connection = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.485953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.486817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:31:57.486913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.487154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.487404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.487645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.487898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.488139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.488390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.488630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.488902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.489138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.489381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.489621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:57.489795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:31:57.515918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.516136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.516363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.518779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.519061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.519250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.524665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.527609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.553605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.553832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.554682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.554917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.606380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.607414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.655410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.655572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.656374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.656610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.812501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.812693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.812808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.812877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.812976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.813678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.836810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.837936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.838018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.838152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.838232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.838392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.849509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.849750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.863488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.863643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.863715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.863817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.864916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:57.881605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.881816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:57.881912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.882094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:57.882188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.882345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:57.882438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.882609 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.882702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:57.882869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.882972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.883151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.883246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.883382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.883476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.883645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.893699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.893855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.893974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.894139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.894226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.894416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.894504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.894703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.901482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.901768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.904377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.904739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.904894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.905041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.905174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.905287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.905545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.905639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.905789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.905874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.906961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.907146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.907228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.907423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.907699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.929828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.930884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.931290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.931575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.932383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.932674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.936782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.937065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.937342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.938082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.938440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.938652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.943694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.943979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.945174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.945466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.949648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.949945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.950239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.950521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.950808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.951090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.951201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.951417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.951694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.951838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.951993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.952285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.952572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.952884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.953161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.953433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.967787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.968134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.969530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.969818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.972038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.973670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.975298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.975594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.976901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.977206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.979806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.981423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.983231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.984607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:57.986745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.987043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.987328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.987614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.987908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.988162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.988256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.988468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.988792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.989088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.989375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:57.989660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.004601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.004910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.005180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.005448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.006315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.006612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.006886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.007154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.012387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.014114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.014269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.015707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.015833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.016111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.017286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.017570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.018816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.019102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.019392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.019676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.020058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.020289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.020597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.020904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.021195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.021585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.031905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.032195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.032482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.032791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.033173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.033465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.033558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.033741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.033824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.034052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.034345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.034731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.035017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.035300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.049223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.051111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.052139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.054096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.055052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.056578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.057028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.058218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.058499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.058620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.058899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.060100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.060388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.061392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.065980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.067436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.067814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.069338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.070333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.070725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.071014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.071295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.072250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.072654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.073408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.073408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.079303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.079593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.079879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.081286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.081583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.081869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.086797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.087080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.087361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.087634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.087903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.088171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.088450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.088754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.088839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:58.089027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.089993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.090105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.090267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.090385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.090542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.090827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.091109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.091383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.091745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.092464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.092782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.093070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:58.125820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596128e39c0 pid: 88071 (default app) Oct 04 08:31:58.128606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596128e39c0 pid: 88072 (default app) Oct 04 08:31:58.129270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e8510-56cb-482d-9cb8-358ae5e182da None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:31:58.129561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e8510-56cb-482d-9cb8-358ae5e182da None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:31:58.129828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e8510-56cb-482d-9cb8-358ae5e182da None None] PATH_INFO: `/v3` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:31:58.133964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Tue Oct 4 08:31:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:05.030221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:05.030739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:05.030853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:05.035173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:05.040764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:05.041234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:05.041375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:05.112131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: INFO dbcounter [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] Registered counter for database keystone Oct 04 08:32:05.131744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG oslo_db.sqlalchemy.engines [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:32:05.138117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writer thread running {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:32:05.316458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG passlib.handlers.bcrypt [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88071) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:32:05.316783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG passlib.handlers.bcrypt [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88071) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:32:05.375144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:05.376781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:05.504283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:32:05.955544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:06.026690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: INFO dbcounter [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] Registered counter for database keystone Oct 04 08:32:06.049027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG oslo_db.sqlalchemy.engines [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:32:06.055399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writer thread running {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:32:06.175745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a1954-10ff-435a-b6bc-62358964b0ed None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:06.180059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:06.180677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:06.180984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:06.181255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:06.189741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:06.242354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING keystone.common.rbac_enforcer.enforcer [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:32:06.242633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42911198-e971-4e93-94a1-91e30848866b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:06.252491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Oct 4 08:32:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:32:06.258451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:06.275171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406b9f-6b10-4ae6-acfc-7ae1f2540373 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:06.280211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:06.281332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:06.281614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:06.281881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] PATH_INFO: `/v3/projects/3c95175d6f124287a997d11bfc5d0ce9` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:06.283439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c95175d6f124287a997d11bfc5d0ce9)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:06.338025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:32:06.338367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030db5d-baf0-41a4-808c-bdf84019b3c9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:06.343370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Oct 4 08:32:06 2022] GET /identity/v3/projects/3c95175d6f124287a997d11bfc5d0ce9 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:08.503205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463f20-3eed-48f6-b3e7-7a8f60162c60 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.503746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463f20-3eed-48f6-b3e7-7a8f60162c60 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.503746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463f20-3eed-48f6-b3e7-7a8f60162c60 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.507798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:08.513538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.514034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.514123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.535107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:08.536634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:08.545102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:32:08.807546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463f20-3eed-48f6-b3e7-7a8f60162c60 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.821813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463f20-3eed-48f6-b3e7-7a8f60162c60 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.827005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27454985-64a6-4a0a-8e5f-c869d5a495eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.827680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27454985-64a6-4a0a-8e5f-c869d5a495eb admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.827965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27454985-64a6-4a0a-8e5f-c869d5a495eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.828237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27454985-64a6-4a0a-8e5f-c869d5a495eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.836601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27454985-64a6-4a0a-8e5f-c869d5a495eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.838490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27454985-64a6-4a0a-8e5f-c869d5a495eb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.847872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Oct 4 08:32:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:32:08.853614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.863119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bec35-a67a-430c-a850-af9cf2ba9dc6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.867442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1abd4c-324a-4ab7-b2eb-0fd1436480cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.868068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1abd4c-324a-4ab7-b2eb-0fd1436480cc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.868348 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1abd4c-324a-4ab7-b2eb-0fd1436480cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.868619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1abd4c-324a-4ab7-b2eb-0fd1436480cc admin admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.869941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1abd4c-324a-4ab7-b2eb-0fd1436480cc admin admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.871764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1abd4c-324a-4ab7-b2eb-0fd1436480cc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.873584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Oct 4 08:32:08 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:11.117953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958fe1-87c6-4047-85d6-25fe18ef15e4 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.118475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958fe1-87c6-4047-85d6-25fe18ef15e4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.118475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958fe1-87c6-4047-85d6-25fe18ef15e4 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.120767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:11.125975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.126500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.126500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.146491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb2ee9-eea1-48f9-82e1-6a85d8bd975c None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.146741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:11.146870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb2ee9-eea1-48f9-82e1-6a85d8bd975c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.147016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb2ee9-eea1-48f9-82e1-6a85d8bd975c None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.147875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:11.148326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:11.155461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.155746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.156028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.199238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG passlib.handlers.bcrypt [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88072) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:32:11.199728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG passlib.handlers.bcrypt [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88072) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:32:11.239838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:11.255503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:11.257203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:11.363896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:11.505368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:11.534011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:11.632597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:11.636696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258976a-64c1-4423-b0f4-b49b3b912e8a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:11.672697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:11.673636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.674092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.674555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.687822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:11.696824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:11.697845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:11.698660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:11.700492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:11.706361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:11.748004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d66be6-2c95-4ae9-9f9b-ce16792a67d5 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:11.752001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:11.795523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:11.796408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.796695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.797002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.798570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:11.818980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c91e-70d7-4ae2-8ccf-31017e6c2b79 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:11.855767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be062e-9532-4474-bc29-1da87da134db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:11.856503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be062e-9532-4474-bc29-1da87da134db None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.856897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be062e-9532-4474-bc29-1da87da134db None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.857176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be062e-9532-4474-bc29-1da87da134db None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.857846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be062e-9532-4474-bc29-1da87da134db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:11.858300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be062e-9532-4474-bc29-1da87da134db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:11.859966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be062e-9532-4474-bc29-1da87da134db None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:11.871336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:11.873252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:11.873682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:11.879528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be062e-9532-4474-bc29-1da87da134db None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:11.989579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:32:11.996743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.001052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.003240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be062e-9532-4474-bc29-1da87da134db None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.042240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.043179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.043640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.043915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.045180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.046715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.048214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:11 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:12.053982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.069884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.119105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1c55b-7e0c-4e3f-9831-9bbecbe8ec0e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.157961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.158852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.159107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.159376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.174649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f5900-088f-4b2e-8158-23e795e41479 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.180216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.181741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:32:12.202167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:12.203091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:32:12.204507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:32:12.204507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:12.204507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:12.204507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:12.209202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.212170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.213080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.213582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.213937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.215180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.219764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.221550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:12.227578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.282332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.323289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.336478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9dde6-076f-4abf-b434-d6d281e7d13c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.347710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06199fa-4ac7-466b-aee5-8e4e7368170b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.374940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.375791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.376073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.376348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.377034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:12.377362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.378724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766e0d-36bd-4386-91c1-a9e054d5086b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.385585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.386283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.386636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.386917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.387725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.domain.id=default, user.id=40a865d2e94a43c8bfaeecc4686bed18) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:12.388097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.389592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019a517-2ccd-4285-95d3-1071058fd2c6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.396818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:12.400941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1322 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/role_assignments?user.id=40a865d2e94a43c8bfaeecc4686bed18&scope.domain.id=default&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 233 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:15.284451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed0ab4-b37a-419f-b554-f1824d8145be None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.285001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed0ab4-b37a-419f-b554-f1824d8145be None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.285001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed0ab4-b37a-419f-b554-f1824d8145be None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.286705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:15.292711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f911-5ec4-48b1-90f5-68061110c26c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.293163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f911-5ec4-48b1-90f5-68061110c26c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.293469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198f911-5ec4-48b1-90f5-68061110c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.326408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1198f911-5ec4-48b1-90f5-68061110c26c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:15.327653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1198f911-5ec4-48b1-90f5-68061110c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:15.414788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9646-76e6-42b1-b5f0-d2211741bd38 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.415263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9646-76e6-42b1-b5f0-d2211741bd38 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.415678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9646-76e6-42b1-b5f0-d2211741bd38 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.417254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 12/23] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:15.427685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da1f2-1c16-4bcd-8219-a65b2e56481b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.428230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da1f2-1c16-4bcd-8219-a65b2e56481b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.428639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da1f2-1c16-4bcd-8219-a65b2e56481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.461710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f43da1f2-1c16-4bcd-8219-a65b2e56481b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:15.468778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f43da1f2-1c16-4bcd-8219-a65b2e56481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:15.478487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:15.636970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:15.654511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e12c56-c182-4908-9d42-13b5b1fbf8d7 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.654795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e12c56-c182-4908-9d42-13b5b1fbf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.655073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e12c56-c182-4908-9d42-13b5b1fbf8d7 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.656697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 13/26] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:15.672214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.672703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.673200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.704354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:15.705822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:15.797434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:15.810308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:16.119510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e12c56-c182-4908-9d42-13b5b1fbf8d7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:16.178459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:16.266291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:16.360597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e12c56-c182-4908-9d42-13b5b1fbf8d7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:16.471201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d4f96-3f6a-4a5d-945b-9365e9936ef8 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:16.484743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cac254-875d-4f86-b546-6a465526d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:16.484743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cac254-875d-4f86-b546-6a465526d2d1 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:16.484743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cac254-875d-4f86-b546-6a465526d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:16.484743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cac254-875d-4f86-b546-6a465526d2d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:16.485138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cac254-875d-4f86-b546-6a465526d2d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:16.486014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cac254-875d-4f86-b546-6a465526d2d1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:16.540755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:16.544764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:16.544764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:16.544764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:16.572743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:16.582915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:16.583825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:16.584589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 15/28] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:16.585259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:16.660627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:16.760410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 14/29] 10.222.0.45 () {60 vars in 1131 bytes} [Tue Oct 4 08:32:16 2022] POST /identity/v3/roles => generated 219 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:16.762283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ec35-b96e-4239-8a04-d46855e6776d None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:16.762868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ec35-b96e-4239-8a04-d46855e6776d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:16.763562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ec35-b96e-4239-8a04-d46855e6776d None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:16.767649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:16.771636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ec35-b96e-4239-8a04-d46855e6776d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:16.799146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650d504-1f8c-4b28-ade3-c7c479c2174d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:16.885268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:16.886275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:16.886736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:16.887188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:16.921825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:16.923669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-43e48c7b-91d8-433d-8545-a5bd05a2725c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:32:16.953218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:16.954129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:32:16.954933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:32:16.954933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:16.954933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:16.959682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 16/31] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:16.961336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:16.963162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:16.963617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.004176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:17.006198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:17.035328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ec35-b96e-4239-8a04-d46855e6776d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:17.091738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:17.092654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.093365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.093962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.094885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:17.096114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:17.099960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6eefb-841e-4e62-b1b0-89b313150d70 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:17.101493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:17.111567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 17/32] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:17.116995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.128206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 16/33] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:17.131344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814e870-3b5e-4a5b-a8dc-25a25a5e057c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.131920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814e870-3b5e-4a5b-a8dc-25a25a5e057c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.132511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814e870-3b5e-4a5b-a8dc-25a25a5e057c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.134289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 17/34] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:17.135577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814e870-3b5e-4a5b-a8dc-25a25a5e057c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.140752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:17.241256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9698d9-38af-45c1-80e6-42fe4903871d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:17.281175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814e870-3b5e-4a5b-a8dc-25a25a5e057c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:17.287268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:17.287828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.288107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.288377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.290003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:17.290315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:17.291841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18008148-f538-4c45-98bd-dbbd432a0f5a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:17.312914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 18/35] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:17.312914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6f53-e88c-4a9d-b52c-acdd7da76c42 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.312914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6f53-e88c-4a9d-b52c-acdd7da76c42 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.312914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6f53-e88c-4a9d-b52c-acdd7da76c42 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.312914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:17.314173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01adc-7d8a-40b5-922f-6c29cb38d9df None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.314677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01adc-7d8a-40b5-922f-6c29cb38d9df None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.315000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01adc-7d8a-40b5-922f-6c29cb38d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.323192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:17.324096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.324550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.326861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.328481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:17.330392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:17.332352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 18/37] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:17 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:17.333393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.338348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9cf01adc-7d8a-40b5-922f-6c29cb38d9df None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:17.339251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9cf01adc-7d8a-40b5-922f-6c29cb38d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:17.411842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:17.420793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 20/38] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:17.420793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.420793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.420793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.437438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:17.438824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:17.447714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:17.462336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c73bc-9fc1-4449-9080-489139659288 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:17.506423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:17.507284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.507738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.508159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.508996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:17.510622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:17.521005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 21/39] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:17.522124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.550632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 19/40] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:32:17 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:17.551999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.746742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcf171-e853-487e-a151-57918caf29f4 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:17.804135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430ff64-929f-4b94-a1f3-86cefc3eff94 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:17.815276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:17.817497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.818173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.818458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.820331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:17.822163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:17.823975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 22/41] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:17.828741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.833462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:17.836939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:17.867540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:17.868546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:17.868891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:17.869169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:17.870521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:17.875199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:17.898042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 20/42] 10.222.0.45 () {60 vars in 1131 bytes} [Tue Oct 4 08:32:17 2022] POST /identity/v3/roles => generated 225 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:17.899057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:17.971935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687658e9-6cef-438e-af00-42e963fff0fd None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:18.018660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:18.019294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:18.019572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:18.019845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:18.020538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:18.022008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:18.149502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88819c-b592-4f7c-80a7-2c20601a17bb None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:18.170211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 23/43] 10.222.0.45 () {60 vars in 1131 bytes} [Tue Oct 4 08:32:17 2022] POST /identity/v3/roles => generated 223 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:18.173926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:18.193566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:18.194258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:18.194533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:18.194871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] PATH_INFO: `/v3/domains/default/users/40a865d2e94a43c8bfaeecc4686bed18/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:18.197504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=40a865d2e94a43c8bfaeecc4686bed18, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:18.198639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:18.219326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 21/44] 10.222.0.45 () {58 vars in 1361 bytes} [Tue Oct 4 08:32:17 2022] PUT /identity/v3/domains/default/users/40a865d2e94a43c8bfaeecc4686bed18/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:18.270940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:18.323240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67381b8b-5b5a-416f-a170-79ac9f779f65 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:18.369318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae6bb5-239f-45f7-a23b-09378b4c4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:18.369999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6bb5-239f-45f7-a23b-09378b4c4aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:18.370288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6bb5-239f-45f7-a23b-09378b4c4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:18.371316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6bb5-239f-45f7-a23b-09378b4c4aa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:18.372824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae6bb5-239f-45f7-a23b-09378b4c4aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:18.374842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae6bb5-239f-45f7-a23b-09378b4c4aa6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:18.376804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 24/45] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:18.384381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:18.433375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:18.524835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fad8b-c6e3-49f7-893a-30166e631352 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:18.564548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2c17c-8ebc-47c5-85c6-b8faf77e1029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:18.565205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c17c-8ebc-47c5-85c6-b8faf77e1029 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:18.565490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c17c-8ebc-47c5-85c6-b8faf77e1029 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:18.565784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c17c-8ebc-47c5-85c6-b8faf77e1029 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:18.566449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2c17c-8ebc-47c5-85c6-b8faf77e1029 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:18.567897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2c17c-8ebc-47c5-85c6-b8faf77e1029 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:18.596774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:32:18 2022] POST /identity/v3/projects => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:20.430946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e38aa-80d4-4598-bdbd-1f5cb9a0708b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.431455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e38aa-80d4-4598-bdbd-1f5cb9a0708b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.431455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e38aa-80d4-4598-bdbd-1f5cb9a0708b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.432951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:20.438916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.439353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.439464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.458934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:20.460437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:20.529280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:20.803705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38819-d39f-43fe-8638-e77057354f7b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.803995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38819-d39f-43fe-8638-e77057354f7b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.804272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb38819-d39f-43fe-8638-e77057354f7b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.805745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 26/49] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:20.806523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.811150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.811432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.811711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.826556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.830247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:20.831761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:20.900581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 27/50] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:20.915503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde047ea-397d-45cf-a5a0-8e0a457803cb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.958232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.958890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.959174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.959455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.974850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:20.979965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:20.981089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:20.981837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 24/51] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:20.989771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.063244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.110964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477070c-1359-42ba-9b77-f861a8509871 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.208838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.277563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.278629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.279165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.279630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.280630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:21.280961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.282376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.296355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 28/52] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.302481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.307783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.333539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f62ac4-cda1-4c6c-9b22-293d95f26ab2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.369254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.369882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.370161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.370433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.371551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.373602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.375202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 25/53] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:21.381023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.420493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e06a11-8582-48e5-a598-8e97c4115ad8 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.447394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.464120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.464795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.465166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.465400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.467178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.468683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.470328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 29/54] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:21.475801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.494781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bf313-00a1-4c09-a2a3-0ad086b4562a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.530998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.531602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.531881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.532159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.532851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.534313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.555436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.564565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 26/55] 10.222.0.45 () {60 vars in 1140 bytes} [Tue Oct 4 08:32:21 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:32:21.586243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6baa76-bafd-4c79-ab1c-a03d6e294ce1 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.626067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99432f24-115b-4e00-9887-a3ca5e0126b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.626732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99432f24-115b-4e00-9887-a3ca5e0126b5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.627014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99432f24-115b-4e00-9887-a3ca5e0126b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.627297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99432f24-115b-4e00-9887-a3ca5e0126b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.628543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99432f24-115b-4e00-9887-a3ca5e0126b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.630107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99432f24-115b-4e00-9887-a3ca5e0126b5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.631806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 30/56] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:21.638373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.777535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7154a-5be2-4c08-8678-f2da9ca9797b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.821062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.821687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.821966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.822238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.823281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.domain.id=default, user.id=40a865d2e94a43c8bfaeecc4686bed18) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:21.823590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.825280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bb10d-cfc1-4c09-8db6-b1e87ef84ebe None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.832597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 27/57] 10.222.0.45 () {56 vars in 1322 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/role_assignments?user.id=40a865d2e94a43c8bfaeecc4686bed18&scope.domain.id=default&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 530 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:23.871181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fc749-ba39-4568-8a6c-ed4e16e6eb34 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:23.871835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fc749-ba39-4568-8a6c-ed4e16e6eb34 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:23.871835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fc749-ba39-4568-8a6c-ed4e16e6eb34 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:23.873190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 31/58] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:23.878267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:23.878668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:23.878899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:23.897488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:23.898691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:23.955075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:23.966241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 28/59] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:24.242259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fc749-ba39-4568-8a6c-ed4e16e6eb34 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:24.324158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:24.372734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fc749-ba39-4568-8a6c-ed4e16e6eb34 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:24.409113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccd63e-9d1b-4fa2-90db-4812d8bfd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:24.409753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccd63e-9d1b-4fa2-90db-4812d8bfd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.410038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccd63e-9d1b-4fa2-90db-4812d8bfd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.410313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccd63e-9d1b-4fa2-90db-4812d8bfd3b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.411447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccd63e-9d1b-4fa2-90db-4812d8bfd3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:24.412944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccd63e-9d1b-4fa2-90db-4812d8bfd3b8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:24.414529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 32/60] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:24.420882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:24.522483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c461-8a4a-48ad-b6bf-4d989b5b4964 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:24.562656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f00861-e51e-431b-a2f4-c5de95cf790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:24.563272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00861-e51e-431b-a2f4-c5de95cf790d None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.563549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00861-e51e-431b-a2f4-c5de95cf790d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.563822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00861-e51e-431b-a2f4-c5de95cf790d None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.564470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00861-e51e-431b-a2f4-c5de95cf790d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:24.565964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00861-e51e-431b-a2f4-c5de95cf790d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:24.593973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 29/61] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:24 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:28.200859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8746-f424-4ff7-82c8-41a4725a929d None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.201863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8746-f424-4ff7-82c8-41a4725a929d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.202348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8746-f424-4ff7-82c8-41a4725a929d None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.203905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 33/62] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:28.209756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319666c-bc42-467a-8ff2-8791b6d48415 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.210612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319666c-bc42-467a-8ff2-8791b6d48415 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.211121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319666c-bc42-467a-8ff2-8791b6d48415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.242160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1319666c-bc42-467a-8ff2-8791b6d48415 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:28.243805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1319666c-bc42-467a-8ff2-8791b6d48415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:28.309414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.343184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 30/63] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:28.415103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7348ae-5c87-4494-8ee8-c7f6d22605dc None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.415693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7348ae-5c87-4494-8ee8-c7f6d22605dc None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.416188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7348ae-5c87-4494-8ee8-c7f6d22605dc None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.417778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 34/64] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:28.424041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd384-b1fd-4f17-9cd1-5eb81ff934d0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.424646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd384-b1fd-4f17-9cd1-5eb81ff934d0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.425167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd384-b1fd-4f17-9cd1-5eb81ff934d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.455496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f8bbd384-b1fd-4f17-9cd1-5eb81ff934d0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:28.457095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f8bbd384-b1fd-4f17-9cd1-5eb81ff934d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:28.554077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 31/65] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:28.562058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6e011-9def-46c9-9b26-f0edc924b93d None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.562619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6e011-9def-46c9-9b26-f0edc924b93d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.563098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6e011-9def-46c9-9b26-f0edc924b93d None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.564656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 35/66] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:28.569955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b132c-1c75-4b14-84d9-50abfb6f60a4 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.570525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b132c-1c75-4b14-84d9-50abfb6f60a4 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.571004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b132c-1c75-4b14-84d9-50abfb6f60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.597820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-fa3b132c-1c75-4b14-84d9-50abfb6f60a4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:28.599035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fa3b132c-1c75-4b14-84d9-50abfb6f60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:28.696490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 32/67] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:28.794924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6e011-9def-46c9-9b26-f0edc924b93d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:28.860055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afde1b9-bb60-45d2-a707-ed715cc8ca4a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.860682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afde1b9-bb60-45d2-a707-ed715cc8ca4a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.861196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afde1b9-bb60-45d2-a707-ed715cc8ca4a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.862948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 33/68] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:28.875245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.875848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.876442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.905504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6e011-9def-46c9-9b26-f0edc924b93d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:28.905955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:28.907393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:28.942168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.946335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.948844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:28.949837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.950476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.950886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.962591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:28.968568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:28.970276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 36/69] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:28.971060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:28.997281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:28.998475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.106463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afac61-e5c6-487e-89f5-47906986d349 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.112920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b92b8-0ef7-4910-b907-384cf4fd6e11 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.144666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.145459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.145635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.145862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.146535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:29.146839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.148388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000a91d-99b4-4dc8-ae6d-75ac9f6de8d2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.153863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.154507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.154791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.155066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.157762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.163639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042f2a-9ab8-4cd3-81fd-a130d6b9887e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.163858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042f2a-9ab8-4cd3-81fd-a130d6b9887e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.164136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042f2a-9ab8-4cd3-81fd-a130d6b9887e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.168957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 36/72] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:29.168957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042f2a-9ab8-4cd3-81fd-a130d6b9887e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.170292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:29.175248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:29.176079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:29.176878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:29.177620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.204765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.237101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.283987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042f2a-9ab8-4cd3-81fd-a130d6b9887e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.291815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf5d02-9599-4644-b9ab-c3bd22bc01bf None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.319336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc07194-aa74-456e-ab3a-2c598136d9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.319968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07194-aa74-456e-ab3a-2c598136d9cb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.320252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07194-aa74-456e-ab3a-2c598136d9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.320519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc07194-aa74-456e-ab3a-2c598136d9cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.328080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.328748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.329029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.329306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.331181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc07194-aa74-456e-ab3a-2c598136d9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-fcc07194-aa74-456e-ab3a-2c598136d9cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:29.335950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:29.336824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:29.341464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.342311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.342311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.347339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.348862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.350529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.353639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.356946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:29.358146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:29.425498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 38/76] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:29.437111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.458153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829509b0-ca1c-4598-a22c-4d6f1dfb38ff None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.460015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.469181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.498216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.498835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.499122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.499400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.500065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:29.500366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.501821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.510361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 39/77] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.510977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.548073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df2f91-d8be-487d-9674-5bba955b0bd3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.590158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.590794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.591198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.591916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.603164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:29.608593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:29.609716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:29.610501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 39/78] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:29.613697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.623321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301621ff-25f2-48bb-b1a8-c0e555e3ef88 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.659947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.660563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.660894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.661167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.661834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:29.662141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.663516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.672587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 40/79] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.673277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.706735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.707381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.728401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8173e3-933f-4da8-9408-def7d7feb00f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.762269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.762874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.763158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.763434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.777216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b9526-39c2-4ac3-b261-49411aff6222 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.811403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.812044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.812328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.812608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.813782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.815226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.816828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 41/80] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.817597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.837078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.838579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.920110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.921929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.925638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cafa69-3546-419c-a57e-24d0e2dca5e3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.939892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 40/81] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:29.941602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.960588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.961238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.961519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.961794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.962450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] RBAC: Adding query filter params (name=member) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:29.962751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.964134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.972835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 42/82] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.973810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.055605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83ef7f-eb9a-44dc-a1c2-4807771a1c03 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.082081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602465ad-62d1-4a71-8267-16455e102b62 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.089086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.089735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.090601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.090905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.092038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.093539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.095121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 41/83] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.096354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.121856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.122594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.122785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.123065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.124210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.125723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.127314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 43/84] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.127314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.148747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.162158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.202805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97375686-0358-4f20-b15c-8f077d0c9c58 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.238582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41319f2-cde8-404b-a96f-f0b6cfa9ac6f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.240353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.241101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.241276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.241543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.276387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.277065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.277351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.277631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.278862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.280326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.282013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 44/85] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.282777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.315574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.317050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.364120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.383641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.388126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76fb0f-6be6-46b6-9738-cd24f6b34658 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.422890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 42/86] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:30.422890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.423170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.423170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.423545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.423747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.424937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.426375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.427947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 45/87] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.429962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.519478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c92a-fea8-4c1c-b167-8ce71ed62ba9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.536646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c0bf-02ff-464b-aa77-7bb8b873afb6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.558436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.559644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.559931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.560199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.573664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.574210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.574497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.574773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.575431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.576925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.579853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.604481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 46/88] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:30 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:30.605860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.639073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.645063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.646610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.726751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866300-eb02-4126-b4e6-38d45a963c4c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.757513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 43/89] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:30.763548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.767049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.767691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.767973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.768246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.769022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=d56821798f4241bc8b4e31c3ac848082) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:30.769332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.770817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.781175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 47/90] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/role_assignments?user.id=d56821798f4241bc8b4e31c3ac848082&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.784013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.834397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.905517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be1f5-e4bc-4afa-8011-584e513b8a1f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.909624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.935922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb08c-0b32-4577-8692-e9f8a52d218b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.956179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.957140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.957427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.957703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.959193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.961136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.963702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 44/91] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.964533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.996270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.997001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.997292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.997708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.117796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37dd80-c004-4971-9ea6-1224da468dc8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.127559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.129820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.145128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:31.161948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.162714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.163004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.163280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.167147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.169441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.178335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 45/92] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:31.178335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.252373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:31.273966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 48/93] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:31.280569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.289411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04daaed-a1f1-4c29-ac57-f4b96de19586 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.325601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.326221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.326606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.326946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.327752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=40a865d2e94a43c8bfaeecc4686bed18) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:31.328149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.329808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.335920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 46/94] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/role_assignments?user.id=40a865d2e94a43c8bfaeecc4686bed18&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:31.336788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.428182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:31.442540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec51cf6-65f4-405e-a539-ad3d9e86b9ed None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.487340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.487961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.488241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.488514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.489289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] RBAC: Adding query filter params (role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=d56821798f4241bc8b4e31c3ac848082) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:31.489598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.492816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.507059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 49/95] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/role_assignments?user.id=d56821798f4241bc8b4e31c3ac848082&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=073ad24837f74fb6979813d89b0e171f => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:31.521555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad11021-8891-491b-9876-e1ad75c8254f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.561452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb7ec-c704-4e8d-ae7d-b9127bbe0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.562118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb7ec-c704-4e8d-ae7d-b9127bbe0410 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.562397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb7ec-c704-4e8d-ae7d-b9127bbe0410 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.562672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb7ec-c704-4e8d-ae7d-b9127bbe0410 None admin] PATH_INFO: `/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.563870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eb7ec-c704-4e8d-ae7d-b9127bbe0410 None admin] RBAC: Authorizing `identity:get_project(project_id=46c0e7b52e0f4ba59511d42a5f7978ba)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.565404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eb7ec-c704-4e8d-ae7d-b9127bbe0410 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.567278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 47/96] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:31.573398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.635121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:31.706398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00698a-4c2d-4625-89ea-439c2644f554 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.744424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.745073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.745350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.745621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.747184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=46c0e7b52e0f4ba59511d42a5f7978ba, user.id=d56821798f4241bc8b4e31c3ac848082) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:31.747500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.749174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc74e72-0f1e-475c-9008-3fbef62a3d90 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.759514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 50/97] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/role_assignments?user.id=d56821798f4241bc8b4e31c3ac848082&scope.project.id=46c0e7b52e0f4ba59511d42a5f7978ba&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:33.630970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1174d-468e-4458-92df-caccd6bf98c2 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.631483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1174d-468e-4458-92df-caccd6bf98c2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.631483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1174d-468e-4458-92df-caccd6bf98c2 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.633235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 48/98] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:33.639339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dda70-7ee5-4d54-b30e-2beedff2352f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.639803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dda70-7ee5-4d54-b30e-2beedff2352f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.639989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dda70-7ee5-4d54-b30e-2beedff2352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.660167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-4b8dda70-7ee5-4d54-b30e-2beedff2352f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:33.661392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4b8dda70-7ee5-4d54-b30e-2beedff2352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:33.754178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 51/99] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:33.958234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac8e67-1867-4abd-b7e1-d503a0986f1a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.958568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac8e67-1867-4abd-b7e1-d503a0986f1a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.958743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac8e67-1867-4abd-b7e1-d503a0986f1a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.960207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 49/100] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:33.978298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5410-eeff-4201-8799-51bcf18ee738 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.978885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5410-eeff-4201-8799-51bcf18ee738 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.979365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5410-eeff-4201-8799-51bcf18ee738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.009674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8e6e5410-eeff-4201-8799-51bcf18ee738 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:34.011181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8e6e5410-eeff-4201-8799-51bcf18ee738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:34.061477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.099221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 52/101] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:34.223655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac8e67-1867-4abd-b7e1-d503a0986f1a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.335599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac8e67-1867-4abd-b7e1-d503a0986f1a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.361122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.375840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bccf4b-f3e3-44d3-bcaf-0acee843ce8f None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.376152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bccf4b-f3e3-44d3-bcaf-0acee843ce8f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.376395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bccf4b-f3e3-44d3-bcaf-0acee843ce8f None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.377578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.378237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.378558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 53/102] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:34.378927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.379212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.381644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.383163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.384904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 50/103] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:34.390477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.390867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.391243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.403080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.419379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:34.421000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:34.534731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 54/104] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:34.570574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.600171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f505aaa-f1f1-4f7f-b185-99504a09d1d4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.669635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce9851-ef72-4053-a28b-f893e8a78df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.670600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9851-ef72-4053-a28b-f893e8a78df8 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.671108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9851-ef72-4053-a28b-f893e8a78df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.671427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9851-ef72-4053-a28b-f893e8a78df8 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.672109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce9851-ef72-4053-a28b-f893e8a78df8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.674343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce9851-ef72-4053-a28b-f893e8a78df8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.727158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 51/105] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:32:34 2022] POST /identity/v3/projects => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:32:34.728479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d3192-3096-4d04-8ba5-b348f42c84e6 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.728788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d3192-3096-4d04-8ba5-b348f42c84e6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.729067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d3192-3096-4d04-8ba5-b348f42c84e6 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.730472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 52/106] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:34.738251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba84c7-2afb-4b1c-9293-66254796ebe6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.738549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba84c7-2afb-4b1c-9293-66254796ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.738814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba84c7-2afb-4b1c-9293-66254796ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.748405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4b518-6b0c-4705-a6db-b825b1d055e9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.763591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.778626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cdba84c7-2afb-4b1c-9293-66254796ebe6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:34.779867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cdba84c7-2afb-4b1c-9293-66254796ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:34.789367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.789940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.790219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.790494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.802532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:34.807636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:34.809184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:34.809936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 55/107] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:34.816468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.845397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.923904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 53/108] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:34.926210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b059b-88cd-447c-bb36-417ab98a73f1 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.926694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b059b-88cd-447c-bb36-417ab98a73f1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.927188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b059b-88cd-447c-bb36-417ab98a73f1 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.929619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 54/109] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:34.930674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b059b-88cd-447c-bb36-417ab98a73f1 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.990766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beeb23-2419-4ffc-9dec-31f9b03e4153 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.041120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.041457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.041831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.042111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.042957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:35.043263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.045275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01f98-bb7e-436d-9a58-8e32974e24b3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.057366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 56/110] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.063755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.063755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.063755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.087693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:35.090272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:35.115442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.129647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b059b-88cd-447c-bb36-417ab98a73f1 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.181011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.182905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.184541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.185748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.190815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 57/111] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:35.201023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.220743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:35.228739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:35.229601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:35.231053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 55/112] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:35.238872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.300648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.432177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc02320-f7e1-4f6b-8023-6cc40410d171 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.486753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676e89e-de28-45db-bd8b-a1670e3cbaad None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.543580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.544268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.544549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.544942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] PATH_INFO: `/v3/users/0c69ed77bbee4777b877219412f82adf` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.568069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.570202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.571155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.571663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.575845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:35.576162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.577748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.578581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] RBAC: Authorizing `identity:get_user(user_id=0c69ed77bbee4777b877219412f82adf)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.580286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.584091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 58/113] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/users/0c69ed77bbee4777b877219412f82adf => generated 289 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.586300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.586794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 56/114] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:35.587672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.629108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.726901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.740941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f539-a3f1-496f-8c30-08a733bacf80 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.744138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f902-5716-4331-a70b-8ad27c95550c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.777567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.778309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.778597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.778873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.781011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.781649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.781929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.782196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.790760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:35.793994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:35.796758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:35.797625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:35.798373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 57/115] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:35.799031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:35.799095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:35.799854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:35.801952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 59/116] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:35.805336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.895517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.907817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0a05-8f1f-4c96-a05b-b383b6fc8ec2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.923726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabdcfa-bcc9-46a2-8067-5cfb46365c13 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.948173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.949006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.949243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.949699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.960347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf8cfa-4672-4dd3-b1cf-d219574dc728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.960867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf8cfa-4672-4dd3-b1cf-d219574dc728 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.961147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf8cfa-4672-4dd3-b1cf-d219574dc728 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.961415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf8cfa-4672-4dd3-b1cf-d219574dc728 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.962535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf8cfa-4672-4dd3-b1cf-d219574dc728 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.963979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf8cfa-4672-4dd3-b1cf-d219574dc728 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.970022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 60/117] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.970022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7daf-5423-48d3-8ea6-11498e5db3b3 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.970022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7daf-5423-48d3-8ea6-11498e5db3b3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.970022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7daf-5423-48d3-8ea6-11498e5db3b3 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.970022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 61/118] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:35.970022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7daf-5423-48d3-8ea6-11498e5db3b3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.975345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.030859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.032412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.089889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7daf-5423-48d3-8ea6-11498e5db3b3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.125860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.126478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.126810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.127058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.127690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:36.127999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.129416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.138575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 62/119] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.139422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.145282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.154606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 58/120] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:36.154606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.204466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.256125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce701-ddf8-4b13-96f2-2d6fd13104db None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.262061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2737-6a3b-49a1-9187-cf44626e5b4e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.295759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.296269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.296556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.296868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.297593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:36.297836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.299216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.300828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e04a6-e595-4829-a045-8005f602fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.301466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e04a6-e595-4829-a045-8005f602fcd6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.301749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e04a6-e595-4829-a045-8005f602fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.302023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e04a6-e595-4829-a045-8005f602fcd6 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.303155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e04a6-e595-4829-a045-8005f602fcd6 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.304596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e04a6-e595-4829-a045-8005f602fcd6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.306266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 59/121] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.311970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.311970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.311970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.312528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 63/122] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.317464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.327219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:36.328422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:36.385639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.408690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 60/123] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:36.412704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.436218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7e97c-ca8a-4582-ac0e-a096af688d96 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.466341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.477969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.478818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.479532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.481105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.482968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.484760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.486367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 64/124] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.487458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.530883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e598-4c28-43fd-9170-ca5ca805bbc4 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.570593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.571234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.571517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.571791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.576739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.576739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.577295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 61/125] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.578175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.603973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a696491-da4f-42cd-ab57-984c62243754 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.641121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.642205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.642686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.643189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/d56821798f4241bc8b4e31c3ac848082/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.645645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cda58b035334e8ca3c10df511347cbc, user_id=d56821798f4241bc8b4e31c3ac848082, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.647335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.650283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.665908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 65/126] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:36 2022] PUT /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/d56821798f4241bc8b4e31c3ac848082/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:36.667169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.719309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4808-b568-4f42-abc5-e4d324f3159a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.743687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.778591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.779338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.779629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.779904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.781533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.783661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.787826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 62/127] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.794335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.829867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5a173-9485-4c32-9163-5f12268b78a9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.876667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.877356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.877644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.877922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.880422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.882586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.884561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 66/128] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.885369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.925915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9252c-8ab2-40c2-b000-667346587af5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.956295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.967391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.968293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.968790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.969243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.970249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] RBAC: Adding query filter params (role.id=0abfc2c6435349d0837dfec95a55a0b2, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=0c69ed77bbee4777b877219412f82adf) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:36.970742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.972535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.979089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 63/129] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/role_assignments?user.id=0c69ed77bbee4777b877219412f82adf&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=0abfc2c6435349d0837dfec95a55a0b2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.980475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.010056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496f243-e0da-4501-99d4-f0f012517dcb None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.064990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.095206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.096331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.097770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.099056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.123521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:37.135827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:37.137771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:37.138839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:37.141879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 67/130] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:37.143023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.193385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc33c5-039c-441d-a317-5bb9e0bddc74 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.237435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.238398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.238817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.239226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.240553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.242281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.244211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 64/131] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.244689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.300430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921d1d9-632a-4844-bb96-f159288f1d14 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.333126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.346766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.347450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.347739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.348013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/40a865d2e94a43c8bfaeecc4686bed18/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.352253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cda58b035334e8ca3c10df511347cbc, user_id=40a865d2e94a43c8bfaeecc4686bed18, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.353765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.377958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 68/132] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:37 2022] PUT /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/40a865d2e94a43c8bfaeecc4686bed18/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:37.378778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.403223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934859a-34df-4e09-b9b3-68fd0742086e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.429736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.454830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.455482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.455772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.456101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.456831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:37.457144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.458786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4be828-978d-4b2b-8767-73f2095fd89b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.468989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 65/133] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.470308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d01f-244f-41ba-8c84-3dd0e70131cb None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.470696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d01f-244f-41ba-8c84-3dd0e70131cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.470980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d01f-244f-41ba-8c84-3dd0e70131cb None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.476106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 66/134] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:37.478790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d01f-244f-41ba-8c84-3dd0e70131cb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.519964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3823c39-35db-482b-84a9-8fc00401b4b4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.594215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717641ce-8efe-4ed3-af62-c75cd959550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.595888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717641ce-8efe-4ed3-af62-c75cd959550f None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.596172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717641ce-8efe-4ed3-af62-c75cd959550f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.596446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717641ce-8efe-4ed3-af62-c75cd959550f None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/d56821798f4241bc8b4e31c3ac848082/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.598889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717641ce-8efe-4ed3-af62-c75cd959550f None admin] RBAC: Authorizing `identity:create_grant(project_id=3cda58b035334e8ca3c10df511347cbc, user_id=d56821798f4241bc8b4e31c3ac848082, role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.600395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717641ce-8efe-4ed3-af62-c75cd959550f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.616100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d01f-244f-41ba-8c84-3dd0e70131cb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.630033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 69/135] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:37 2022] PUT /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/d56821798f4241bc8b4e31c3ac848082/roles/073ad24837f74fb6979813d89b0e171f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:37.631636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.631928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.632205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.651689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:37.653009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:37.667142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.668239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.668861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.669399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.670872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.672764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.675104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 67/136] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.685908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.698827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.737951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 70/137] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:37.776455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.862689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0b1b-26b0-44af-a087-62c32816977b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.913539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.914210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.914505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.914786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] PATH_INFO: `/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.916128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] RBAC: Authorizing `identity:get_project(project_id=46c0e7b52e0f4ba59511d42a5f7978ba)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.917712 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.919677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 68/138] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:37.925702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:38.057417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b386d-aafa-4ab5-a30f-6fe99a372327 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:38.099435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:38.100113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.100397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.100674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] PATH_INFO: `/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba/users/d56821798f4241bc8b4e31c3ac848082/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.102650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] RBAC: Authorizing `identity:create_grant(project_id=46c0e7b52e0f4ba59511d42a5f7978ba, user_id=d56821798f4241bc8b4e31c3ac848082, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:38.104115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:38.131359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 71/139] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:37 2022] PUT /identity/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba/users/d56821798f4241bc8b4e31c3ac848082/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:38.196488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:38.333127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e51a-19e7-4011-aec3-532f94c26e9d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:38.351122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:38.380745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8c16-3b99-4cde-ab42-0694a4a2c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:38.381800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8c16-3b99-4cde-ab42-0694a4a2c2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.382294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8c16-3b99-4cde-ab42-0694a4a2c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.382770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8c16-3b99-4cde-ab42-0694a4a2c2c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.391644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d8c16-3b99-4cde-ab42-0694a4a2c2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:38.393580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d8c16-3b99-4cde-ab42-0694a4a2c2c5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:38.395884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 69/140] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:38.401650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:38.450912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:38.546192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56705e87-9b68-4502-9435-8fe9eb0a6af3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:38.592993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113b51-b91a-4c17-bff1-a53c01c5f926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:38.593543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113b51-b91a-4c17-bff1-a53c01c5f926 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.593827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113b51-b91a-4c17-bff1-a53c01c5f926 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.594103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113b51-b91a-4c17-bff1-a53c01c5f926 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.594779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39113b51-b91a-4c17-bff1-a53c01c5f926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:38.596251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39113b51-b91a-4c17-bff1-a53c01c5f926 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:38.630512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 72/141] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:38 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:39.551281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c40d2-ce41-4e72-b110-dbabd8b3d1db None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.552321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c40d2-ce41-4e72-b110-dbabd8b3d1db None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.552856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c40d2-ce41-4e72-b110-dbabd8b3d1db None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.554717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 70/142] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:39.570124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddce326-27a4-4404-8b5c-b6d3f83471de None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.570619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddce326-27a4-4404-8b5c-b6d3f83471de None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.570711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddce326-27a4-4404-8b5c-b6d3f83471de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.597855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-1ddce326-27a4-4404-8b5c-b6d3f83471de None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:39.599088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1ddce326-27a4-4404-8b5c-b6d3f83471de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:39.680098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 73/143] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:40.206569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06f848-d904-4aba-bb45-197c1a6c79b9 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.206912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06f848-d904-4aba-bb45-197c1a6c79b9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.207138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06f848-d904-4aba-bb45-197c1a6c79b9 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.208802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 71/144] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:40.214047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673b58-93e9-4853-bd2b-04b67f063a5c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.215023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673b58-93e9-4853-bd2b-04b67f063a5c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.215306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673b58-93e9-4853-bd2b-04b67f063a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.241756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ff673b58-93e9-4853-bd2b-04b67f063a5c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:40.243073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ff673b58-93e9-4853-bd2b-04b67f063a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:40.258948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06f848-d904-4aba-bb45-197c1a6c79b9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.264184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.378377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 74/145] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:40.379410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81ab1e-45aa-4975-8015-bacdb8406eca None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.379699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81ab1e-45aa-4975-8015-bacdb8406eca None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.379973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81ab1e-45aa-4975-8015-bacdb8406eca None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.381271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 75/146] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:40.391772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.392072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.392330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.418570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06f848-d904-4aba-bb45-197c1a6c79b9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.432248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:40.433546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:40.469782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.470435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.470886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.471164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.488026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:40.493244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:40.494144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:40.494928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:40.495745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 72/147] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:40.503311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.560249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.602046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 76/148] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:40.647706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cfedc-1fdc-4c53-b666-ba29a0d006ce None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.707355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.708034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.708312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.708590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.709304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:40.709608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:40.711009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:40.722923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 73/149] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:40.728343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.846326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.869508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dfcea-6062-4e58-9c0d-08e7316cd5a0 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.919589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.920144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.920419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.920692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.925428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:40.926905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:40.928512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 77/150] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:40.934576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.023673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.080099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d250041-0239-4164-8a1d-d20bf2b5ec98 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.081772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.124053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.124677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.125144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.125423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.222612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.224298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.323261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6110f-1c4a-4b9c-8b06-06614392ed01 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.350026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 74/151] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:41.350927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.353639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.409048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.410073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.410553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.411042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.434212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:41.439957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:41.440857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:41.441716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:41.450419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 78/152] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:41.451504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.464539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.487196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5513-6598-479b-b030-e987211cbff3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.546432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.547087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.547367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.547635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.564432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:41.570184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:41.571033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 75/153] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:41.572183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.669028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b39f2-925e-4a6f-99f8-e6c1f07cede7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.694979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.729441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.730739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.731021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.731294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.732499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.734272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.736140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 79/154] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:41.736694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.754892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31395-7bfc-4dcb-aa4c-de3abf8372ec None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.818141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.819054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.819529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.819951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.822204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:41.822682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.824899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e04749-e81e-4934-816c-698fe4873f40 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.842100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 76/155] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:41.843590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3d73-60a9-4380-a84c-a4ca1ad0f0ae None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.844020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3d73-60a9-4380-a84c-a4ca1ad0f0ae None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.844453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3d73-60a9-4380-a84c-a4ca1ad0f0ae None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.846049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 77/156] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:41.846883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3d73-60a9-4380-a84c-a4ca1ad0f0ae None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.869098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.906841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d00c-9bb9-4f84-8db8-ecdac58d147c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.962884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.963519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.963799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.964167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.964882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:41.965185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.966583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.981107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 80/157] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:41.982297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.106059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3d73-60a9-4380-a84c-a4ca1ad0f0ae None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.162786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415d19-8857-45ea-ab67-6d124ca89c57 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.163461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:42.181942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.182562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.183413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.183684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.184452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=d56821798f4241bc8b4e31c3ac848082) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:42.192844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:42.194403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575194d-2aeb-4478-a5d8-41f02c151d3d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:42.215343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 78/158] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/role_assignments?user.id=d56821798f4241bc8b4e31c3ac848082&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:42.216744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfed603-e354-4336-90ba-0bf055726266 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.217033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfed603-e354-4336-90ba-0bf055726266 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.217307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfed603-e354-4336-90ba-0bf055726266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.233730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.234401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.234681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.234952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] PATH_INFO: `/v3/users/0c69ed77bbee4777b877219412f82adf` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.241653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] RBAC: Authorizing `identity:get_user(user_id=0c69ed77bbee4777b877219412f82adf)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:42.243154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:42.244874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 81/159] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/users/0c69ed77bbee4777b877219412f82adf => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:42.246494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.255111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:42.262453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-abfed603-e354-4336-90ba-0bf055726266 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:42.265086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-abfed603-e354-4336-90ba-0bf055726266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:42.398644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 79/160] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:42.399860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08eb1-5cd7-426b-8fde-7559505c155b None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.400136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08eb1-5cd7-426b-8fde-7559505c155b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.400403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08eb1-5cd7-426b-8fde-7559505c155b None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.402687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 80/161] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:42.403279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08eb1-5cd7-426b-8fde-7559505c155b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.543503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed045a-7aed-48b8-a90f-8ba83a40e40e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.588289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030d87-c2db-42bb-9d7d-ff20e89581bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.592201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030d87-c2db-42bb-9d7d-ff20e89581bc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.592671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030d87-c2db-42bb-9d7d-ff20e89581bc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.593187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030d87-c2db-42bb-9d7d-ff20e89581bc None admin] PATH_INFO: `/v3/users/40a865d2e94a43c8bfaeecc4686bed18` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.593395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08eb1-5cd7-426b-8fde-7559505c155b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.595192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7030d87-c2db-42bb-9d7d-ff20e89581bc None admin] RBAC: Authorizing `identity:get_user(user_id=40a865d2e94a43c8bfaeecc4686bed18)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:42.597778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7030d87-c2db-42bb-9d7d-ff20e89581bc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:42.599917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 82/162] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/users/40a865d2e94a43c8bfaeecc4686bed18 => generated 247 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:42.601289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.601729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.602656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.623045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:42.624527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:42.637250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:42.676963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.677551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.677883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.678155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.679347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:42.680893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:42.687243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 81/163] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:42.687243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.710227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 83/164] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:42.711763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.715327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:42.836297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffe53-146e-4c81-9f2f-d8e9cc607459 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.880365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.881473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.881891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.882319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/0c69ed77bbee4777b877219412f82adf/roles/0abfc2c6435349d0837dfec95a55a0b2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.884371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] RBAC: Authorizing `identity:create_grant(project_id=3cda58b035334e8ca3c10df511347cbc, user_id=0c69ed77bbee4777b877219412f82adf, role_id=0abfc2c6435349d0837dfec95a55a0b2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:42.886962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:42.896742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b084df9-f7a5-441c-9a05-7c008aedc55e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.910270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 84/165] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:42 2022] PUT /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc/users/0c69ed77bbee4777b877219412f82adf/roles/0abfc2c6435349d0837dfec95a55a0b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:42.911419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.943369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.943895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.944220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.944503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.019133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.045469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.065929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.067468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.081443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234f58-16ca-4599-98a6-dabcfb398adb None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.140274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.140963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.141350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.141625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.161802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:43.171467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:43.172436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:43.173471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 85/166] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:43.181862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.263015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 82/167] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:43.269081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.401116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.419067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a200-faeb-44a8-8902-dc19e2dd2404 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.430851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907566c-fe4f-479f-867b-e2a6c1f317af None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.474408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.488029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.488649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.488947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.489216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.489882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:43.490175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.494559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.507007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.507654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.507929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.508198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.511717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.513216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 86/168] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:43.513508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.514142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.516758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 83/169] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:43.522150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.716640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0d96a-e6ec-44b3-bb32-b0b392d5e6f5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.739039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b36ad-5fcd-4042-98bf-252cca39455d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.764396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.765637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.766169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.766648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.768252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.770279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.772883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 84/170] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:43.774554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.805927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.830308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7a836-1c7e-47b9-b199-308cc8e87648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.831375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a836-1c7e-47b9-b199-308cc8e87648 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.831888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a836-1c7e-47b9-b199-308cc8e87648 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.832356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a836-1c7e-47b9-b199-308cc8e87648 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.856449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7a836-1c7e-47b9-b199-308cc8e87648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-76c7a836-1c7e-47b9-b199-308cc8e87648 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:43.863914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:43.865203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:43.866049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:43.868189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 87/171] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:43.869744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3d2d-df2d-4644-8d57-73b269dcbf96 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.870815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3d2d-df2d-4644-8d57-73b269dcbf96 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.871294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3d2d-df2d-4644-8d57-73b269dcbf96 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.872823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 88/172] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:43.873729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3d2d-df2d-4644-8d57-73b269dcbf96 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.928901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.933804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17865a-b192-4097-8aaa-994aa0f713e3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.984983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.985643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.985924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.986192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.987175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=40a865d2e94a43c8bfaeecc4686bed18) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:43.987483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.989358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86849637-1430-4a56-ae98-3ac0fd172c1d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.000807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 85/173] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/role_assignments?user.id=40a865d2e94a43c8bfaeecc4686bed18&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.002486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de392a1-3651-4074-a853-f04494377442 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.002984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de392a1-3651-4074-a853-f04494377442 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.003482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de392a1-3651-4074-a853-f04494377442 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.006405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 86/174] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:44.007652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de392a1-3651-4074-a853-f04494377442 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.018328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3d2d-df2d-4644-8d57-73b269dcbf96 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.102124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.103114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.103734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.104206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.166387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.190055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de392a1-3651-4074-a853-f04494377442 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.236294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.237863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.238298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.238695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.239500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:44.239941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.241560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7542ad9-43d1-49f9-9525-0147f373eaae None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.252947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 87/175] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.255303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b39b-fadf-4adf-8fe3-9c7aed877b66 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.255939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b39b-fadf-4adf-8fe3-9c7aed877b66 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.256531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b39b-fadf-4adf-8fe3-9c7aed877b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.291096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.293537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.293846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8b20b39b-fadf-4adf-8fe3-9c7aed877b66 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:44.295065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8b20b39b-fadf-4adf-8fe3-9c7aed877b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:44.356429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.390576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 88/176] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:44.391924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fb8b-78cf-4f97-b35a-abc20ca9afb0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.392212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fb8b-78cf-4f97-b35a-abc20ca9afb0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.392493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fb8b-78cf-4f97-b35a-abc20ca9afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.418445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8092fb8b-78cf-4f97-b35a-abc20ca9afb0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:44.419732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8092fb8b-78cf-4f97-b35a-abc20ca9afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:44.433963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 89/177] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:44.435619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.515352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 89/178] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:44.516646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda177-2fa7-499b-8b82-6bd09ac3182e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.516962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda177-2fa7-499b-8b82-6bd09ac3182e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.517241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda177-2fa7-499b-8b82-6bd09ac3182e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.518826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 90/179] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:44.519544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda177-2fa7-499b-8b82-6bd09ac3182e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.537552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.621521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0e657-7d90-4bd1-8ca0-8751a3b2388f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.687850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cb2b0-ddcf-4725-933e-f4aed531da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.688495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cb2b0-ddcf-4725-933e-f4aed531da51 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.688800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cb2b0-ddcf-4725-933e-f4aed531da51 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.689083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cb2b0-ddcf-4725-933e-f4aed531da51 None admin] PATH_INFO: `/v3/users/d56821798f4241bc8b4e31c3ac848082` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.690228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cb2b0-ddcf-4725-933e-f4aed531da51 None admin] RBAC: Authorizing `identity:get_user(user_id=d56821798f4241bc8b4e31c3ac848082)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.691667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cb2b0-ddcf-4725-933e-f4aed531da51 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.693603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 90/180] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/users/d56821798f4241bc8b4e31c3ac848082 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.696095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.696387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.696660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.700611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda177-2fa7-499b-8b82-6bd09ac3182e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.718100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:44.719597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:44.729893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.750659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.751364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.751563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.751827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.753870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.756311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.759585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 91/181] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.761373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.808768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 91/182] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:44.808768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.881488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.909095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be02f6-ba20-42bc-a76b-9a082086e64e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.909313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb28dc-67b5-4cc9-8e60-2b61677807e9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.944024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.944764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.945180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.945514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.946680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.947334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.947695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.947972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.959642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.963452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:44.970913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:44.972056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:44.973022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:44.975313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 92/183] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:44.976232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.031738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.033738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.086646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26648-6acf-4533-8dee-975e35a0ef76 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.140800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.141493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.141780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.142392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.143143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] RBAC: Adding query filter params (role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=d56821798f4241bc8b4e31c3ac848082) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:45.143457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.145024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.148893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.150969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 92/184] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:45.152044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.156835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 93/185] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/role_assignments?user.id=d56821798f4241bc8b4e31c3ac848082&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=073ad24837f74fb6979813d89b0e171f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.156835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.207520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.288674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a29d85-a8ac-4db2-91e1-ed5a4abb8569 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.325566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382f9f7-eb29-4bc1-8d0d-388a2912380b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.337427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.338544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.339584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.340060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.352419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:45.358036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:45.359280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:45.360092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 93/186] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:45.365013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.366143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.366800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.367054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.367276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.367963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:45.368271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.375024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.384839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 94/187] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.389652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.464623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.503422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd183c8-1e5e-4d82-87c7-4b3ac9b8ba76 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.506582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.517251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ec96-ee3d-472f-93a9-64eb782a801e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.543419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.544053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.544357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.544592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.545851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.547426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.549603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 94/188] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.550483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.561028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.561677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.561956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.562227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] PATH_INFO: `/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.563767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] RBAC: Authorizing `identity:get_project(project_id=46c0e7b52e0f4ba59511d42a5f7978ba)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.565584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.567360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 95/189] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/projects/46c0e7b52e0f4ba59511d42a5f7978ba => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.572482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.662625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f8212-e7e6-4a5c-877b-f86f08e2b449 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.683718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ea5a-ae44-4255-8497-77454853b79e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.699314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.699927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.700199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.700501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.701196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:45.701635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.703109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.712479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 95/190] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.713233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.720239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.727269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.728071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.728206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.728465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] PATH_INFO: `/v3/users/27dd1f04b9fb4d6396ab1e807363ebec` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.743779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] RBAC: Authorizing `identity:get_user(user_id=27dd1f04b9fb4d6396ab1e807363ebec)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.745905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.747571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 96/191] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/users/27dd1f04b9fb4d6396ab1e807363ebec => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.748335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.756096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.829745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a15e4-c520-463c-8f58-a30774b4db0c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.849488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410b135-4bd0-4c49-b182-c3392bda6117 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.862951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.863553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.863826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.864207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.864748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.866188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.886367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.887071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.887178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 96/192] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:45 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:45.887277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.887618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.888422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=46c0e7b52e0f4ba59511d42a5f7978ba, user.id=d56821798f4241bc8b4e31c3ac848082) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:45.888770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.890244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be8594-7f26-4030-b818-a3e42ce31a0e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.893743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.896885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 97/193] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/role_assignments?user.id=d56821798f4241bc8b4e31c3ac848082&scope.project.id=46c0e7b52e0f4ba59511d42a5f7978ba&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.898185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426c1e1-71b1-406c-82a9-6a8247f9cb53 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.898472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426c1e1-71b1-406c-82a9-6a8247f9cb53 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.898746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426c1e1-71b1-406c-82a9-6a8247f9cb53 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.905550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 98/194] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:45.905550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426c1e1-71b1-406c-82a9-6a8247f9cb53 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.969733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.012262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.033100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55444675-a01b-4cdf-9244-ea5426d650e2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.041463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426c1e1-71b1-406c-82a9-6a8247f9cb53 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.080090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2500fdc-3215-4c00-9f69-a107fe679854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.080789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500fdc-3215-4c00-9f69-a107fe679854 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.081071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500fdc-3215-4c00-9f69-a107fe679854 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.081337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500fdc-3215-4c00-9f69-a107fe679854 None admin] PATH_INFO: `/v3/users/27dd1f04b9fb4d6396ab1e807363ebec` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.082769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500fdc-3215-4c00-9f69-a107fe679854 None admin] RBAC: Authorizing `identity:get_user(user_id=27dd1f04b9fb4d6396ab1e807363ebec)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.085647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500fdc-3215-4c00-9f69-a107fe679854 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.093208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 97/195] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/users/27dd1f04b9fb4d6396ab1e807363ebec => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:46.094693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.094975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.095248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.096077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.096756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.097045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.097435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.138277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:46.139515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:46.202899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.204378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.227524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 98/196] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:46.228388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.275229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.343144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 99/197] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:46.348036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.350517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.366538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71357de-b074-4264-94d4-3436c9f7d195 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.408846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.409609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.409894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.410168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.487096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebf85-5174-4ec5-ad58-a7a39a7a71d0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.495601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.497343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.534565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.535141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.535420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.535696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.537450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.538974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.540629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 100/198] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:46.547313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.585144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.608774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.631984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 99/199] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:46.637364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.669017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6869bb-6c14-47ee-8507-adf66d9ab199 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.720195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.720866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.721147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.721421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.736649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:46.741622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:46.742501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:46.743277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:46.748424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 101/200] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:46.749368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.752883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cb2d2-d0e4-454a-b107-173b57ff2b44 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.803586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.804533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.804855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.805130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.805873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=27dd1f04b9fb4d6396ab1e807363ebec) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:46.806183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.808880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.817505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 100/201] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/role_assignments?user.id=27dd1f04b9fb4d6396ab1e807363ebec&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:46.821506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.857638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.900397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa281-e420-457e-84d5-f46aa1f0e100 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.932954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.981215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.981975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.982260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.982530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.985924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.987452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.989253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 102/202] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.005802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.023952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a4b65-140a-4148-ab61-b0742110d7ec None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.069654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.070197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.070480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.070758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.071437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:47.075196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.076622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.086987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 101/203] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.094569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.228431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc70b5-b30a-4377-9799-843db0e0a019 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.288551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586b293-6bd5-4fc6-96aa-7d09f9488c7c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.313088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.321493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.322068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.322354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.322656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.323913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] RBAC: Adding query filter params (role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=27dd1f04b9fb4d6396ab1e807363ebec) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:47.324226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.324327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.324930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.325207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.325476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] PATH_INFO: `/v3/users/0c69ed77bbee4777b877219412f82adf` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.325717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.326977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] RBAC: Authorizing `identity:get_user(user_id=0c69ed77bbee4777b877219412f82adf)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.328429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.330362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 102/204] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/users/0c69ed77bbee4777b877219412f82adf => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.337117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 103/205] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/role_assignments?user.id=27dd1f04b9fb4d6396ab1e807363ebec&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=073ad24837f74fb6979813d89b0e171f => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.337839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.449344 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51f7e6-2a91-4e4c-9db2-20b84e3090e3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.485858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.486477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.486753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.487021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.542931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.564394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.565973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.674258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 103/206] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:47.681852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.713124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.799250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbfbc8-43a4-4023-a3a6-da636c6fca18 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.838959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e77b5-2042-494a-b2aa-ac11119f2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.839611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e77b5-2042-494a-b2aa-ac11119f2cce None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.839891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e77b5-2042-494a-b2aa-ac11119f2cce None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.840162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e77b5-2042-494a-b2aa-ac11119f2cce None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.844236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e77b5-2042-494a-b2aa-ac11119f2cce None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.845741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e77b5-2042-494a-b2aa-ac11119f2cce None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.847685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 104/207] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.853624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.958086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.985903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5505b6-4884-4941-8353-9c8f5e0d5015 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.039878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.040501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.040801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.041074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.042380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] RBAC: Adding query filter params (role.id=0abfc2c6435349d0837dfec95a55a0b2, scope.project.id=3cda58b035334e8ca3c10df511347cbc, user.id=0c69ed77bbee4777b877219412f82adf) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:48.042684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.044130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419a59-e720-4b98-8547-3eeffcdafaca None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.053259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 104/208] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/role_assignments?user.id=0c69ed77bbee4777b877219412f82adf&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=0abfc2c6435349d0837dfec95a55a0b2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.553665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260c5b-cd7c-4706-b825-4221c2223eb6 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.554362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260c5b-cd7c-4706-b825-4221c2223eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.554362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260c5b-cd7c-4706-b825-4221c2223eb6 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.555544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 105/209] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:48.561098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738eb2f-e3e1-4395-83b2-b5a7d5339622 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.561391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738eb2f-e3e1-4395-83b2-b5a7d5339622 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.561669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738eb2f-e3e1-4395-83b2-b5a7d5339622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.583599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7738eb2f-e3e1-4395-83b2-b5a7d5339622 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:48.584873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7738eb2f-e3e1-4395-83b2-b5a7d5339622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:48.668890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 105/210] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:48.960406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260c5b-cd7c-4706-b825-4221c2223eb6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.036258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b07b3-9d7b-4f62-bc16-d7063f8c1f75 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.037264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b07b3-9d7b-4f62-bc16-d7063f8c1f75 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.037750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b07b3-9d7b-4f62-bc16-d7063f8c1f75 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.039626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 106/211] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:49.046124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.046412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.046687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.052207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.067994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:49.069717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:49.073590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260c5b-cd7c-4706-b825-4221c2223eb6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.121389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.122033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.122309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.122579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.133805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:49.138961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:49.139893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:49.140736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 106/212] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:49.146138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.157286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 107/213] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:49.258380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21637c5-b5f5-4b77-9b0f-155606c0c680 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.294621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.295689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.296212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.296681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.297576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:49.298091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.299686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f968df-04d2-4f5a-a536-7bbfe9c4bc8a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.309628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 107/214] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:49.317219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.319455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.327509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b3437-0764-4927-b2ec-3b7ab4426efa None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.328771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b3437-0764-4927-b2ec-3b7ab4426efa None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.329061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b3437-0764-4927-b2ec-3b7ab4426efa None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.330807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 108/215] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:49.337680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.337966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.338241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.346255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.363424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:49.365167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:49.427850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40157fe-fdfb-4932-abb8-fe9f3c787471 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.438687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 109/216] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:49.439641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.469279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.470219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.470669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.471107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] PATH_INFO: `/v3/users/09e682b2923e45ffb7ee9db06c47b84c` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.486902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] RBAC: Authorizing `identity:get_user(user_id=09e682b2923e45ffb7ee9db06c47b84c)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.488839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.490735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 108/217] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/users/09e682b2923e45ffb7ee9db06c47b84c => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:49.496152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.548659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecbab6-4f8d-4530-82f8-f53a0190221e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.562876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.586989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.593746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.594782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.595064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.595338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.596464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.598003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.600584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 110/218] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:49.606394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.615968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd554-4f4f-4e74-86ba-075de5fc8d37 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.658835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.659456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.659732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.660004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.715546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102c9c0-83aa-4fe1-832e-cb696d236e18 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.744292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.746839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.752427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.753078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.753356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.753626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.754279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.755709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.778360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 111/219] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:49 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:32:49.779626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.821663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.876688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 109/220] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:32:49.878201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.886229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.940529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572845-6407-40cc-9f9e-b5139cb953a7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.983242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241891f-a42b-47c6-b284-13ff9f659d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.983891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241891f-a42b-47c6-b284-13ff9f659d37 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.984176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241891f-a42b-47c6-b284-13ff9f659d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.984452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241891f-a42b-47c6-b284-13ff9f659d37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.998338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241891f-a42b-47c6-b284-13ff9f659d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-0241891f-a42b-47c6-b284-13ff9f659d37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:50.003406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:50.004306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:50.005182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 112/221] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:50.005867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d841cf-3142-4cec-96df-1ce6ec803ff2 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.006149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d841cf-3142-4cec-96df-1ce6ec803ff2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.006418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d841cf-3142-4cec-96df-1ce6ec803ff2 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.008512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 113/222] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:50.013148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d841cf-3142-4cec-96df-1ce6ec803ff2 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.014019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4b9b-696c-4b63-9b12-0b4a3c020db9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.055396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2eae2-19e3-478a-8ee8-6adeaeb0cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.056033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2eae2-19e3-478a-8ee8-6adeaeb0cd54 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.056033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2eae2-19e3-478a-8ee8-6adeaeb0cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.056330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2eae2-19e3-478a-8ee8-6adeaeb0cd54 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.058196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2eae2-19e3-478a-8ee8-6adeaeb0cd54 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.059655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2eae2-19e3-478a-8ee8-6adeaeb0cd54 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.061522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 110/223] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:50.062696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.062992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.063269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.084414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:50.085006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:50.122212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.141778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d841cf-3142-4cec-96df-1ce6ec803ff2 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.161169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.176555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 111/224] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:50.177830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.188418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.189073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.189355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.189630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.190435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:50.190741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.192210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.202803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 114/225] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:50.209139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.313380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cc158-354e-46a3-abc3-931bfb8e7b62 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.350443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0aff-6fcc-4692-bb19-c4afeaeb460a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.393001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.393625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.393905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.394177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.394912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=09e682b2923e45ffb7ee9db06c47b84c) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:50.395223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.396671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.413287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.413931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.414216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.414495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] PATH_INFO: `/v3/users/27dd1f04b9fb4d6396ab1e807363ebec` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.414639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 112/226] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/role_assignments?user.id=09e682b2923e45ffb7ee9db06c47b84c&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:50.421676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] RBAC: Authorizing `identity:get_user(user_id=27dd1f04b9fb4d6396ab1e807363ebec)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.423258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.425328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 115/227] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/users/27dd1f04b9fb4d6396ab1e807363ebec => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:50.430743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.472094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.487711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.577302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.617500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71709-9dc9-4101-941b-d4b1f1be24d7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.656447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.657146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.657424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.657697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.658851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.660300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.662021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 113/228] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:50.667848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.679462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac901e04-50bf-4f6c-aa44-2545d03c8632 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.723009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.723653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.723932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.724200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.736268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:50.741763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:50.742640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:50.743433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 116/229] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:50.749932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.782282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.794940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d53a1-aeed-4e8e-8b4d-f51747dfb6da None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.853523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.854932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.855370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.855788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/27dd1f04b9fb4d6396ab1e807363ebec/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.863421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3202b9808af44d3a1f42d456c93ddca, user_id=27dd1f04b9fb4d6396ab1e807363ebec, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.866637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.883471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5a40e-9855-4a8d-9dfa-56472387ab5e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.890882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 114/230] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:50 2022] PUT /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/27dd1f04b9fb4d6396ab1e807363ebec/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:50.898500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.943989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.944882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.945397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.945884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.946700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:50.947165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.949435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.959184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 117/231] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:50.970006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.093538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e638fd-d0dc-46d0-8a76-26658eea3735 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.133053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.133839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.134068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.134398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] PATH_INFO: `/v3/users/27dd1f04b9fb4d6396ab1e807363ebec` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.136243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] RBAC: Authorizing `identity:get_user(user_id=27dd1f04b9fb4d6396ab1e807363ebec)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:51.138130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:51.140106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 115/232] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/users/27dd1f04b9fb4d6396ab1e807363ebec => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:51.145858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.288932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56ca11-3c61-4f64-9ab5-68533d72e256 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.326834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885dfde-34f0-44bf-b17c-5f1f18db99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.327544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885dfde-34f0-44bf-b17c-5f1f18db99fb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.327829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885dfde-34f0-44bf-b17c-5f1f18db99fb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.328107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885dfde-34f0-44bf-b17c-5f1f18db99fb None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.330876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885dfde-34f0-44bf-b17c-5f1f18db99fb None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:51.332625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885dfde-34f0-44bf-b17c-5f1f18db99fb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:51.334702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 118/233] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:51 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:51.341165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.370576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:51.469017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f6ad-fecf-4c66-a943-c9581bf1c89c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.512835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ea857-88fd-4487-9477-028ced57fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.513569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ea857-88fd-4487-9477-028ced57fc91 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.513855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ea857-88fd-4487-9477-028ced57fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.514132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ea857-88fd-4487-9477-028ced57fc91 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/27dd1f04b9fb4d6396ab1e807363ebec/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.516310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ea857-88fd-4487-9477-028ced57fc91 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3202b9808af44d3a1f42d456c93ddca, user_id=27dd1f04b9fb4d6396ab1e807363ebec, role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:51.517809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ea857-88fd-4487-9477-028ced57fc91 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:51.538736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 116/234] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:51 2022] PUT /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/27dd1f04b9fb4d6396ab1e807363ebec/roles/073ad24837f74fb6979813d89b0e171f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:32:52.335598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33423e0f-bade-4f0f-8707-03d05eb18449 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.336112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33423e0f-bade-4f0f-8707-03d05eb18449 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.336112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33423e0f-bade-4f0f-8707-03d05eb18449 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.337791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 119/235] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:52.343703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.344128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.344300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.369590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:52.370836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:52.464270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 117/236] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:52.738338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33423e0f-bade-4f0f-8707-03d05eb18449 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.789826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.876829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33423e0f-bade-4f0f-8707-03d05eb18449 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.931098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68f699-a645-4d58-bedf-345e835b6265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.931738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68f699-a645-4d58-bedf-345e835b6265 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.932597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68f699-a645-4d58-bedf-345e835b6265 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.932936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68f699-a645-4d58-bedf-345e835b6265 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.953250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68f699-a645-4d58-bedf-345e835b6265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7d68f699-a645-4d58-bedf-345e835b6265 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:52.958771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:52.959642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:52.960433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 120/237] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:52.968136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.988309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.011528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480e85-3b3e-4d6e-b9bb-c031e5ecc98b None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.011709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480e85-3b3e-4d6e-b9bb-c031e5ecc98b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.011984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480e85-3b3e-4d6e-b9bb-c031e5ecc98b None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.014235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 121/238] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:53.020548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ce12c-5db8-487f-81ea-54bf290090b7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.020881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ce12c-5db8-487f-81ea-54bf290090b7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.021159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ce12c-5db8-487f-81ea-54bf290090b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.052232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-aa3ce12c-5db8-487f-81ea-54bf290090b7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:53.054589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aa3ce12c-5db8-487f-81ea-54bf290090b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:53.140493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3bf2-7396-4a3a-8714-25add0b30c59 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.181218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 122/239] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:53.182692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d52e7-cc77-436c-9eec-6b298276a38e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.183038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d52e7-cc77-436c-9eec-6b298276a38e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.183275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d52e7-cc77-436c-9eec-6b298276a38e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.184829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 123/240] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:53.189971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.190360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.190733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.190839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.191359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.191640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.191913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.192586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:53.192912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.194418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.218314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 118/241] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:53.219538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:53.220901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:53.224025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.269220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.363527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 124/242] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:53.364604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.401548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386f4cd-db92-43ad-97f3-d1fc68e6dcee None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.451819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.452467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.452763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.453042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] PATH_INFO: `/v3/users/a4479a60f76e4b6cb9953982bda76572` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.471503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] RBAC: Authorizing `identity:get_user(user_id=a4479a60f76e4b6cb9953982bda76572)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.473006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.474750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 119/243] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/users/a4479a60f76e4b6cb9953982bda76572 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:53.480514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.578254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.661814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ce4c-fa1c-455f-897f-de88261e3ca9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.710602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.711678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.715030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.715332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.717755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b263496-719c-459e-8b07-1c10da166d8c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.753212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.754876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.761975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.762736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.763107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.763488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.775013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:53.780564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:53.781500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:53.782298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 120/244] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:53.783191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.821325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.824810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.912563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511668-cc59-4d3c-8cd9-07c2a8830e05 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.951713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.952481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.952861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.953214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.954384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.955429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 125/245] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:53.956177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.956353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.962415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 121/246] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:53.963699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.024657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.027633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.073420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8d3b-4f68-4be3-81ee-73c1c0ed3fda None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.078995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be89d4b-357e-4cbd-8174-5bbd7bd4ff41 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.109345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.109983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.110263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.110538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.111652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.113128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.114943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 122/247] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:54.115586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.121563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.122306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.122590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.122930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.123624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:54.123926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.125425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba6ba1-f3b6-48d0-b311-c3e2ec1aabcb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.145007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 126/248] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:54.145007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bdd0e-51e2-4cdb-905d-2047644e833e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.145007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bdd0e-51e2-4cdb-905d-2047644e833e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.145007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bdd0e-51e2-4cdb-905d-2047644e833e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.145007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 127/249] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:54.145007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bdd0e-51e2-4cdb-905d-2047644e833e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.244980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1bc9-7152-4e06-bed7-d46fd379e88e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.257883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bdd0e-51e2-4cdb-905d-2047644e833e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.273522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.278227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.283492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.284151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.284405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.284665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.285358 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.286812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.300831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.301378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.301679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.301921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.302652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] RBAC: Adding query filter params (role.id=0abfc2c6435349d0837dfec95a55a0b2, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=a4479a60f76e4b6cb9953982bda76572) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:54.302990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.304399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f3951-50c2-44fa-b8ff-e6bafc04a162 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.311178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 123/250] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:54.317523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.320970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 128/251] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:54 2022] GET /identity/v3/role_assignments?user.id=a4479a60f76e4b6cb9953982bda76572&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=0abfc2c6435349d0837dfec95a55a0b2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:54.322463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a415266-0775-41fb-bb43-7004658e852c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.323310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a415266-0775-41fb-bb43-7004658e852c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.323592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a415266-0775-41fb-bb43-7004658e852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.345271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4a415266-0775-41fb-bb43-7004658e852c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:54.346663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4a415266-0775-41fb-bb43-7004658e852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:54.440257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 129/252] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:54.441663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28eee-c445-4b41-a9e6-e166901bf160 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.442058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28eee-c445-4b41-a9e6-e166901bf160 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.442340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28eee-c445-4b41-a9e6-e166901bf160 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.444203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 130/253] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:54.450617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.450896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.451196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.470141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e6b1-abb1-4133-a6b6-ec41d1cd873e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.477615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:54.479905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:54.514325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.514803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.515570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.515570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] PATH_INFO: `/v3/users/09e682b2923e45ffb7ee9db06c47b84c` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.516582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] RBAC: Authorizing `identity:get_user(user_id=09e682b2923e45ffb7ee9db06c47b84c)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.518089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.520051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 124/254] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:54 2022] GET /identity/v3/users/09e682b2923e45ffb7ee9db06c47b84c => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:54.526273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.585438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 131/255] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:54.605124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.658926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e8b3c-121b-41fb-8abd-156ad1c340b0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.694704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.695344 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.695626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.695900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.697067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.699166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.701152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 125/256] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:54 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:54.706899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.752910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.796331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.817688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1b907-1c4c-46e0-bad5-97acd020758d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.866331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.867345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.867639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.867920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/09e682b2923e45ffb7ee9db06c47b84c/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.870340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] RBAC: Authorizing `identity:create_grant(project_id=f3202b9808af44d3a1f42d456c93ddca, user_id=09e682b2923e45ffb7ee9db06c47b84c, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.872328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.890025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 132/257] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:54 2022] PUT /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/09e682b2923e45ffb7ee9db06c47b84c/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:54.910577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.937533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11694-0d06-4d94-add2-16135bfd0fac None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.962508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.988728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.989395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.989676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.989991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.006050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:55.012246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:55.013233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:55.014056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 126/258] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:55.022060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.053462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b098-2bde-49df-9b72-3dbf8b53ebcb None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.057763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.113025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.113972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.114258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.114530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.133097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:55.140268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:55.141264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:55.142041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:32:55.142652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 133/259] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:55.150416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.171363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d711d7a-7b26-48d1-a568-fcf8bd9a716b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.220173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.221152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.221659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.222134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.223070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:55.223617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.226070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.236503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 127/260] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:55.241789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.302596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06156-6cdc-4bb3-8f3b-220690834ef0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.304086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.362587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.368413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.369115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.370194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.371322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:55.371865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.373539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.394860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb433e2-3519-497e-bcb7-ccc4cdaaff35 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.403546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 134/261] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:55.408974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.459159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.459159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.459159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.459159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] PATH_INFO: `/v3/users/27dd1f04b9fb4d6396ab1e807363ebec` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.461259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.461714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] RBAC: Authorizing `identity:get_user(user_id=27dd1f04b9fb4d6396ab1e807363ebec)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.462879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.469160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 128/262] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/users/27dd1f04b9fb4d6396ab1e807363ebec => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:55.472739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.589299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b15f2-0fd1-46ee-97f5-0060db433b95 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.647091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.648089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.648613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.649114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] PATH_INFO: `/v3/users/27dd1f04b9fb4d6396ab1e807363ebec` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.655270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] RBAC: Authorizing `identity:get_user(user_id=27dd1f04b9fb4d6396ab1e807363ebec)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.657195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.659390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 135/263] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/users/27dd1f04b9fb4d6396ab1e807363ebec => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:55.668706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.674526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb628d-e566-43ff-8566-e0a66094f80b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.690777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.742079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.742707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.742984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.743249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.810457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.821967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875f43f-4ab6-4e52-9748-857440e415b8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.861105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.861441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.862133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.862479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.862593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.862860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.960663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.962274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.963642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 129/264] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:32:55.969748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.983116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:56.064896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:56.076161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 136/265] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:32:56.090664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:56.125443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b8f86-7fab-4366-8cf9-0ff6fb01cdf3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:56.166456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:56.167099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:56.167376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:56.167761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:56.169317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:56.170510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:56.172502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 130/266] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:56.179212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:56.208282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd10a-d7f8-4ea2-a2cc-ba3892e29d71 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:56.252113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:56.253986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:56.255456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:56.256533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:56.258258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:56.260652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:56.262728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 137/267] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:56 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:56.268419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:56.295497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:56.327888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb402187-ecaf-4669-89f9-2179782e97ef None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:56.342200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:56.375483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:56.376684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:56.377216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:56.377804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:56.379001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=27dd1f04b9fb4d6396ab1e807363ebec) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:56.379514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:56.381169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c06af5-18c2-4ddc-9372-5afe0f32c5e6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:56.390193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 131/268] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:56 2022] GET /identity/v3/role_assignments?user.id=27dd1f04b9fb4d6396ab1e807363ebec&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:56.403241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fc743-27ed-4b98-bc4d-5e1f24f618aa None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:56.449433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:56.450308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:56.450736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:56.451185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:56.452072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] RBAC: Adding query filter params (role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=27dd1f04b9fb4d6396ab1e807363ebec) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:56.452547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:56.454172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b395e2-dd07-4b5c-b8b5-9fd21db02281 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:56.461523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 138/269] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:56 2022] GET /identity/v3/role_assignments?user.id=27dd1f04b9fb4d6396ab1e807363ebec&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=073ad24837f74fb6979813d89b0e171f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:57.058718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c5762-a3e9-4871-a107-fbd39307435a None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.059236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c5762-a3e9-4871-a107-fbd39307435a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.059236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c5762-a3e9-4871-a107-fbd39307435a None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.060865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 132/270] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:57.066371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.066665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.066945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.091345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:57.092566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:57.190507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 139/271] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:57.475402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c5762-a3e9-4871-a107-fbd39307435a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:57.583917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c5762-a3e9-4871-a107-fbd39307435a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:57.619621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:57.620263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.620544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.620846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.628695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:57.633681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:57.640472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:57.641425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:57.642220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:57.644533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 133/272] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:57.650676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:57.708606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:57.760351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4ae3-b9e3-4f05-ae57-c3e0c2ee04c8 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:57.798905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:57.800023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.800511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.801020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.801931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:57.802448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:57.804129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7f113-dd01-4007-bdff-602eedfd7de6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:57.814997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 140/273] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:57.821886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:57.926160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39bad-53b4-4439-b0b9-bed31e304905 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.926505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39bad-53b4-4439-b0b9-bed31e304905 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.926709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39bad-53b4-4439-b0b9-bed31e304905 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.928182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 141/274] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:57.934597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416978a-42cf-4278-832c-ebbfa6fb97d8 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:57.935509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234180-07de-4049-95fb-eb41b0f37620 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.935797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234180-07de-4049-95fb-eb41b0f37620 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.936073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4234180-07de-4049-95fb-eb41b0f37620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.959799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c4234180-07de-4049-95fb-eb41b0f37620 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:57.961010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c4234180-07de-4049-95fb-eb41b0f37620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:57.986355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d03d-ab2b-43bf-9616-3e2f96388972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:57.986994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d03d-ab2b-43bf-9616-3e2f96388972 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.987276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d03d-ab2b-43bf-9616-3e2f96388972 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.987546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d03d-ab2b-43bf-9616-3e2f96388972 None admin] PATH_INFO: `/v3/users/a4479a60f76e4b6cb9953982bda76572` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.988763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d03d-ab2b-43bf-9616-3e2f96388972 None admin] RBAC: Authorizing `identity:get_user(user_id=a4479a60f76e4b6cb9953982bda76572)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:57.990158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d03d-ab2b-43bf-9616-3e2f96388972 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:57.991898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 134/275] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:57 2022] GET /identity/v3/users/a4479a60f76e4b6cb9953982bda76572 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:57.996774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8e74-cab4-48b7-8d1d-2c59af72335b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.996774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8e74-cab4-48b7-8d1d-2c59af72335b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.996774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8e74-cab4-48b7-8d1d-2c59af72335b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.996774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 135/276] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:58.000920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8e74-cab4-48b7-8d1d-2c59af72335b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.045304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 142/277] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:58.046386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c254e-18b3-4a57-add6-017e3268cdd7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.046674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c254e-18b3-4a57-add6-017e3268cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.046948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c254e-18b3-4a57-add6-017e3268cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.070191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3b2c254e-18b3-4a57-add6-017e3268cdd7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:58.071393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3b2c254e-18b3-4a57-add6-017e3268cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:58.082150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.129196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8e74-cab4-48b7-8d1d-2c59af72335b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.133026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.160788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 143/278] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:58.160788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8583615-07c2-4607-a716-18e215f13429 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.160788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8583615-07c2-4607-a716-18e215f13429 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.160788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8583615-07c2-4607-a716-18e215f13429 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.165979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 144/279] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:58.167930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.168133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.168409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.174155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.174983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.175445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.175854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.177163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.178734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.180798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 136/280] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:57 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:58.187000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.191943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:58.193276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:58.284741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 145/281] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:58.298136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ec307-28de-4bec-9548-7d901590ddee None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.332092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.333699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.334378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.334989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.335270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/a4479a60f76e4b6cb9953982bda76572/roles/0abfc2c6435349d0837dfec95a55a0b2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.338384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] RBAC: Authorizing `identity:create_grant(project_id=f3202b9808af44d3a1f42d456c93ddca, user_id=a4479a60f76e4b6cb9953982bda76572, role_id=0abfc2c6435349d0837dfec95a55a0b2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.340180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.344487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.360873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 137/282] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:58 2022] PUT /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca/users/a4479a60f76e4b6cb9953982bda76572/roles/0abfc2c6435349d0837dfec95a55a0b2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:32:58.464948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0ae42-33c4-4aba-bf17-9a30e25c6fb1 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.473516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.473706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.506087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.506749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.507027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.507301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.508505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.511243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.513427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 146/283] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:58.519139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.606322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242ffa-9965-40f2-aff7-a5447559c87e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.639340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ed2d6-ac01-48ee-85d0-37937e42ca23 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.646848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.647494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.647770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.648047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.660868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:58.666826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:58.667884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:58.668747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 138/284] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:58.669433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.687555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.688324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.688412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.688778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.689350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.690784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.724760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 147/285] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:58 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:32:58.724760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.756423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.767141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.826364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617afbc7-f1fa-44b5-86e4-9ca385e0cbd3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.857124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9d9e-18e1-4381-8bd7-037af89114d5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.875826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.876698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.877380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.877758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.893817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:58.899280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321332-a683-436e-8642-f235db080334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.899909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321332-a683-436e-8642-f235db080334 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.900191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321332-a683-436e-8642-f235db080334 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.900507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321332-a683-436e-8642-f235db080334 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:58.900613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:58.902111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:58.903758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:32:58.905000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321332-a683-436e-8642-f235db080334 None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:58.905000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321332-a683-436e-8642-f235db080334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.905000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321332-a683-436e-8642-f235db080334 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.905292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 139/286] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:58.910049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.913417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 148/287] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:58.919479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321332-a683-436e-8642-f235db080334 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.034762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322c876-11fb-4961-aea1-3836a8aabd73 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.049551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.059325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.062579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321332-a683-436e-8642-f235db080334 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.084832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.085768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.086051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.086332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.087002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:59.087304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.089409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.100176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 140/288] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:59.106811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.107386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.108499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.109051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.109521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] PATH_INFO: `/v3/users/e205036b82c747c78ff2ab2a129908ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.133664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] RBAC: Authorizing `identity:get_user(user_id=e205036b82c747c78ff2ab2a129908ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.135956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.138937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 149/289] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/users/e205036b82c747c78ff2ab2a129908ab => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:59.144889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.247660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4c9ad-ab71-41e6-b7a2-516d99ee46b0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.263858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32e97-6ecf-4a94-82a6-a76f89a6b42a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.287290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af1321-9379-4b78-a617-013e53421662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.288208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af1321-9379-4b78-a617-013e53421662 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.288598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af1321-9379-4b78-a617-013e53421662 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.289014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af1321-9379-4b78-a617-013e53421662 None admin] PATH_INFO: `/v3/users/09e682b2923e45ffb7ee9db06c47b84c` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.290377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af1321-9379-4b78-a617-013e53421662 None admin] RBAC: Authorizing `identity:get_user(user_id=09e682b2923e45ffb7ee9db06c47b84c)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.292868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af1321-9379-4b78-a617-013e53421662 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.295225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 141/290] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/users/09e682b2923e45ffb7ee9db06c47b84c => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:59.302282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af1321-9379-4b78-a617-013e53421662 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.307878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.308781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.309254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.309915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.311622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, user.id=e205036b82c747c78ff2ab2a129908ab, scope.system=all) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:59.312131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.314046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.320928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 150/291] 10.222.0.45 () {56 vars in 1308 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/role_assignments?user.id=e205036b82c747c78ff2ab2a129908ab&scope.system=all&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:59.369860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.437012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af1321-9379-4b78-a617-013e53421662 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.475420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.476126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.476409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.476685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.552196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.554735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.613632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.662203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 142/292] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:32:59.668417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.686016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.790610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d872c96-feb9-4cc6-ae86-652f418a3ab9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.840267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366c388-cdcb-4043-927c-4490bbd60f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.840944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c388-cdcb-4043-927c-4490bbd60f61 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.841229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c388-cdcb-4043-927c-4490bbd60f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.841504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366c388-cdcb-4043-927c-4490bbd60f61 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.842669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366c388-cdcb-4043-927c-4490bbd60f61 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.844129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366c388-cdcb-4043-927c-4490bbd60f61 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.845812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 151/293] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:59.851808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.958361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddaa25-ee0b-4ff1-a620-6083ace0d4c5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.998056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.998682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.998964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.999250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.000018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=09e682b2923e45ffb7ee9db06c47b84c) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:00.000391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:00.001885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647045f-aaee-4f46-8186-27a8b3b42080 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:00.008640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 143/294] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/role_assignments?user.id=09e682b2923e45ffb7ee9db06c47b84c&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:00.781333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801497-4858-4cd0-9f56-81b47de2bbbe None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.781771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801497-4858-4cd0-9f56-81b47de2bbbe None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.781966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801497-4858-4cd0-9f56-81b47de2bbbe None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.783412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 152/295] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:00.788904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.789747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.790213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.809631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:00.811218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:00.814404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.889315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 144/296] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:01.165410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801497-4858-4cd0-9f56-81b47de2bbbe None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.257732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.278311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801497-4858-4cd0-9f56-81b47de2bbbe None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.315819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e719-7f9c-43d3-8a60-ad67652858b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.316550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e719-7f9c-43d3-8a60-ad67652858b0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.316877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e719-7f9c-43d3-8a60-ad67652858b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.317149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e719-7f9c-43d3-8a60-ad67652858b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e719-7f9c-43d3-8a60-ad67652858b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-b4b6e719-7f9c-43d3-8a60-ad67652858b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:01.335668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:01.336631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:01.337474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 153/297] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:01.345180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.450720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbed6b-0ff8-435e-9424-1bbaf0d9cb4d None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.450888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbed6b-0ff8-435e-9424-1bbaf0d9cb4d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.451210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbed6b-0ff8-435e-9424-1bbaf0d9cb4d None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.452765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 154/298] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:01.458121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.458401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.458677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.459436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc530b-e5c7-459f-b03e-70e323567ff4 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.477419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:01.479475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:01.498660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.499649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.500120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.500582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.501557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:01.502071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.503629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.513308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 145/299] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.519303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.522430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.559632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 155/300] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:01.629336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d1010-434c-4967-9d1c-5e4e30c3c389 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.666069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686586-6928-4634-b283-24178f3b4481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.667124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686586-6928-4634-b283-24178f3b4481 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.667603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686586-6928-4634-b283-24178f3b4481 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.668069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686586-6928-4634-b283-24178f3b4481 None admin] PATH_INFO: `/v3/users/a4479a60f76e4b6cb9953982bda76572` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.669429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56686586-6928-4634-b283-24178f3b4481 None admin] RBAC: Authorizing `identity:get_user(user_id=a4479a60f76e4b6cb9953982bda76572)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.671089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56686586-6928-4634-b283-24178f3b4481 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.672884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 146/301] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/users/a4479a60f76e4b6cb9953982bda76572 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:01.678573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.768108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.810962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda4c12-ec21-4de6-970a-c73987b2a0bd None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.824291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89483e-9903-4460-a1a4-f7e895206615 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.825287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89483e-9903-4460-a1a4-f7e895206615 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.825817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89483e-9903-4460-a1a4-f7e895206615 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.827649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 147/302] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:01.833560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.833844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.834122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.854468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb046f-287a-4840-83b4-aba282ca8e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.854877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:01.855731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb046f-287a-4840-83b4-aba282ca8e6f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.856070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:01.856411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb046f-287a-4840-83b4-aba282ca8e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.856942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb046f-287a-4840-83b4-aba282ca8e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.926677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.931923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 148/303] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 08:33:01.932757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.933732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb046f-287a-4840-83b4-aba282ca8e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.935202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb046f-287a-4840-83b4-aba282ca8e6f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.008678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.045601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 156/304] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:02.046950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf243db-12cd-40c1-9776-98a456f344c5 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.047301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf243db-12cd-40c1-9776-98a456f344c5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.047642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf243db-12cd-40c1-9776-98a456f344c5 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.049163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 157/305] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:02.053702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf243db-12cd-40c1-9776-98a456f344c5 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.055384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d18e-ce1c-4979-a2fe-ecba6d9ad7a3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.096907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfdf5b-31f0-4f7d-aee6-6b085400ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.097549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdf5b-31f0-4f7d-aee6-6b085400ab6e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.097827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdf5b-31f0-4f7d-aee6-6b085400ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfdf5b-31f0-4f7d-aee6-6b085400ab6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.111777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfdf5b-31f0-4f7d-aee6-6b085400ab6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-b6dfdf5b-31f0-4f7d-aee6-6b085400ab6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:02.117204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:02.118290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:02.119374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 149/306] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:02.124839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.125215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.125436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.146800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:02.148025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:02.178294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf243db-12cd-40c1-9776-98a456f344c5 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.210076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.217725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.218521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.218903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.219246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.220442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.221926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.222494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 150/307] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:02.223056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.223854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 158/308] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.224471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.275188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.328630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f1181-aef9-48d3-a79d-b450841471b5 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.365224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.366688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.367436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.367618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd443f-937d-4d37-b6ed-2df44209ebe6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.368347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.369900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.370695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.373456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.394215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 151/309] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.394215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.409595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.410221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.410512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.410794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.411896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.413393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.415307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 159/310] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.416092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.460885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.512956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b56805-1d41-4a14-aa2d-0e3027b68f87 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.548952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.549558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.549839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.550111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.550844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] RBAC: Adding query filter params (role.id=0abfc2c6435349d0837dfec95a55a0b2, scope.project.id=f3202b9808af44d3a1f42d456c93ddca, user.id=a4479a60f76e4b6cb9953982bda76572) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.551153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.552594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.559039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 152/311] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/role_assignments?user.id=a4479a60f76e4b6cb9953982bda76572&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=0abfc2c6435349d0837dfec95a55a0b2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.559821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.559927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514576fe-22cd-4483-a22a-06c8904cb19b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.571225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.601396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.602006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.602294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.602569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] PATH_INFO: `/v3/users/eb4b3f488404418d9f11412fecc479dc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.618440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4b3f488404418d9f11412fecc479dc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.620173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.622208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 160/312] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/users/eb4b3f488404418d9f11412fecc479dc => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.627949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.678711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7d6d-a0ec-4694-baab-cc41f3eada9a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.698200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.722751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.723387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.723672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.723950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] PATH_INFO: `/v3/groups` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.724600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.726193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.744445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c0e07-fe2d-4c13-b9fb-858905ad8367 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.753237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 153/313] 10.222.0.45 () {60 vars in 1134 bytes} [Tue Oct 4 08:33:02 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:02.754741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.795899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.796548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.796884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.797175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.813592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:02.819135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:02.820845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:02.822760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 161/314] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:02.827339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.873420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.920387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b525-32a4-4ff4-a42d-41fa5e579387 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.965841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.965841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.966158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.966256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.966948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] RBAC: Adding query filter params (role.id=0abfc2c6435349d0837dfec95a55a0b2, user.id=eb4b3f488404418d9f11412fecc479dc, scope.system=all) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.967251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.968772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.974879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 154/315] 10.222.0.45 () {56 vars in 1308 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/role_assignments?user.id=eb4b3f488404418d9f11412fecc479dc&scope.system=all&role.id=0abfc2c6435349d0837dfec95a55a0b2 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.980698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7616a-15ad-4d4b-a12a-042a35aaa33d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.031129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.033832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.033832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.033832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.033832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:03.033832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.036777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.046945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 162/316] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:03.052561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.110062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:03.192243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2d5e2-2224-45ae-bf1c-1c823c148d1f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.228180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd345b19-505d-44e7-9249-75ceb69e2e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.229385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345b19-505d-44e7-9249-75ceb69e2e00 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.229661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345b19-505d-44e7-9249-75ceb69e2e00 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.229929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345b19-505d-44e7-9249-75ceb69e2e00 None admin] PATH_INFO: `/v3/users/e205036b82c747c78ff2ab2a129908ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.231103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd345b19-505d-44e7-9249-75ceb69e2e00 None admin] RBAC: Authorizing `identity:get_user(user_id=e205036b82c747c78ff2ab2a129908ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.232886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd345b19-505d-44e7-9249-75ceb69e2e00 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.238880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 155/317] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/users/e205036b82c747c78ff2ab2a129908ab => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:03.240118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.335676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:03.349730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b90b4-5337-4f1c-933c-deee9becdfb6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.388099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02379a27-f203-4265-a08a-38b0f6107ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.388791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02379a27-f203-4265-a08a-38b0f6107ee7 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.389071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02379a27-f203-4265-a08a-38b0f6107ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.389387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02379a27-f203-4265-a08a-38b0f6107ee7 None admin] PATH_INFO: `/v3/system/users/e205036b82c747c78ff2ab2a129908ab/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.390737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02379a27-f203-4265-a08a-38b0f6107ee7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e205036b82c747c78ff2ab2a129908ab, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.392136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02379a27-f203-4265-a08a-38b0f6107ee7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.408823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 163/318] 10.222.0.45 () {58 vars in 1334 bytes} [Tue Oct 4 08:33:03 2022] PUT /identity/v3/system/users/e205036b82c747c78ff2ab2a129908ab/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:05.015974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4b9b3-68cb-4ac4-8a3f-57a807227451 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.016499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4b9b3-68cb-4ac4-8a3f-57a807227451 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.016499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4b9b3-68cb-4ac4-8a3f-57a807227451 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.018066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 156/319] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:05.023387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbad3-012f-45bf-81eb-092e25ea4c3c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.023926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbad3-012f-45bf-81eb-092e25ea4c3c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.023926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbad3-012f-45bf-81eb-092e25ea4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.043639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7cbcbad3-012f-45bf-81eb-092e25ea4c3c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:05.044872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7cbcbad3-012f-45bf-81eb-092e25ea4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.132796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 164/320] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:05.205264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cff20c-a068-44ac-86c3-1f4a43318cf9 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.205574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cff20c-a068-44ac-86c3-1f4a43318cf9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.205823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cff20c-a068-44ac-86c3-1f4a43318cf9 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.207304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 157/321] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:05.212498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237992e7-2613-4d1b-b27b-c53ac5651148 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.213356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237992e7-2613-4d1b-b27b-c53ac5651148 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.213631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237992e7-2613-4d1b-b27b-c53ac5651148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.231992 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-237992e7-2613-4d1b-b27b-c53ac5651148 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:05.233483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-237992e7-2613-4d1b-b27b-c53ac5651148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.306912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 165/322] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:05.408893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cff20c-a068-44ac-86c3-1f4a43318cf9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.524927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cff20c-a068-44ac-86c3-1f4a43318cf9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:05.537081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.564514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:05.565092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.565369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.565637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.566730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:05.568280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:05.569639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495c70-1620-4dbc-8198-1a9a088ec182 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.572755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495c70-1620-4dbc-8198-1a9a088ec182 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.572892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 158/323] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:05.572967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495c70-1620-4dbc-8198-1a9a088ec182 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.572967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 166/324] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:05.576017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.578392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.578674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.578940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.597785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:05.598996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.607922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.671434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 167/325] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:05.673032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.685165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d230e3-a7f5-4fdd-aadb-3beb8dc77128 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:05.724682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:05.725264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.725772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.726092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] PATH_INFO: `/v3/groups` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.727112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:05.728908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:05.747870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 159/326] 10.222.0.45 () {60 vars in 1134 bytes} [Tue Oct 4 08:33:05 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:33:05.793824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8655bd-0dde-4cd0-b290-00d29ed0f344 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:05.835191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:05.835754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.836031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.836422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.849121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:05.854894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:05.855852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:05.861672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 168/327] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:05.862635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.906912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.941893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.945370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.989005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2562-dcf4-4f25-bcd4-7fdd29745cbb None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.042304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.042944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.043207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.043471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.044137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:06.044432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.045911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.056777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 160/328] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.062771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.078067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377ef08-c0cd-4ac3-96a8-47ff30cac424 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.133413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.134057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.134905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.135301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.153055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:06.158218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:06.159139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:06.159983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:06.160836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 169/329] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:06.165567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.210350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.217618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1183f-ce15-4d62-af9a-7422b09b0393 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.250101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.272272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.273112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.273760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.273891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] PATH_INFO: `/v3/users/eb4b3f488404418d9f11412fecc479dc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.275693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4b3f488404418d9f11412fecc479dc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.278270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.280766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 161/330] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/users/eb4b3f488404418d9f11412fecc479dc => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.286677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.310218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473c2f-7ee6-4042-b228-6ce60f51534e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.362896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.363910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.364397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.364897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.365778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:06.366310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.367937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.378278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 170/331] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:06.384380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.418801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5a52-4807-49b4-9a2c-80dedd62e809 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.458778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.459529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.459817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.460091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] PATH_INFO: `/v3/system/users/eb4b3f488404418d9f11412fecc479dc/roles/0abfc2c6435349d0837dfec95a55a0b2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.461766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eb4b3f488404418d9f11412fecc479dc, role_id=0abfc2c6435349d0837dfec95a55a0b2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.464060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.485755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 162/332] 10.222.0.45 () {58 vars in 1334 bytes} [Tue Oct 4 08:33:06 2022] PUT /identity/v3/system/users/eb4b3f488404418d9f11412fecc479dc/roles/0abfc2c6435349d0837dfec95a55a0b2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:06.534835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23922bd4-1b0f-48a8-a6e2-9f4ce20023ec None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.567861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.581274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ce404-656f-47cd-b1bf-7a198de0a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.582421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ce404-656f-47cd-b1bf-7a198de0a347 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.582963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ce404-656f-47cd-b1bf-7a198de0a347 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.583440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ce404-656f-47cd-b1bf-7a198de0a347 None admin] PATH_INFO: `/v3/users/e205036b82c747c78ff2ab2a129908ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.585069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ce404-656f-47cd-b1bf-7a198de0a347 None admin] RBAC: Authorizing `identity:get_user(user_id=e205036b82c747c78ff2ab2a129908ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.586855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ce404-656f-47cd-b1bf-7a198de0a347 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.589929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 171/333] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/users/e205036b82c747c78ff2ab2a129908ab => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.596025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.640247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.728075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f721f19-fad2-4c41-8e81-9c327d40176d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.770381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.771006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.771285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.771560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.772306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] RBAC: Adding query filter params (role.id=d92f4eb019b54a4183aaf372d9a066ab, user.id=e205036b82c747c78ff2ab2a129908ab, scope.system=all) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:06.772610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.774087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8ed7f-818c-4951-9fcc-cf3ca2ade2c7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.793306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 163/334] 10.222.0.45 () {56 vars in 1308 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/role_assignments?user.id=e205036b82c747c78ff2ab2a129908ab&scope.system=all&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:08.448991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597630f-535e-487a-a413-a6fb12616e8c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.449589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597630f-535e-487a-a413-a6fb12616e8c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.449589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597630f-535e-487a-a413-a6fb12616e8c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.451362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 172/335] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:08.460950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a97a7-535a-4735-8120-26db2fb6a43d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.461510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a97a7-535a-4735-8120-26db2fb6a43d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.461510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a97a7-535a-4735-8120-26db2fb6a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.489948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0b3a97a7-535a-4735-8120-26db2fb6a43d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:08.491272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0b3a97a7-535a-4735-8120-26db2fb6a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:08.577419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 164/336] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:08.637325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328e10-0e74-4e2b-aa66-47aabb203327 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.637726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328e10-0e74-4e2b-aa66-47aabb203327 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.638006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328e10-0e74-4e2b-aa66-47aabb203327 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.639680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 173/337] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:08.646877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.647286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.647716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.676648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:08.678046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:08.700180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:08.769277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 165/338] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:09.141549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20328e10-0e74-4e2b-aa66-47aabb203327 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.266430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20328e10-0e74-4e2b-aa66-47aabb203327 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:09.306751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:09.307166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.307534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.307877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.319244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:09.324232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:09.325225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:09.326472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 174/339] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:09.331518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.371599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.448748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:09.544227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7d2dd-01b0-43f1-b525-719ef5610b44 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:09.547511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffce3b-33b8-4cdc-a7f0-d145874050b6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:09.603823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:09.604548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.604856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.605196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.606772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:09.607645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.607926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.608262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.608977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] RBAC: Adding query filter params (name=member) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:09.609280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:09.610688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa897d-735d-40e8-81ec-c387aa220618 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:09.619319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:09.623836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 166/340] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:09.624519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:09.625424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:09.626212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:09.626837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168231b-3fe2-44b2-b551-a8e1267ed07e None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.627402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 175/341] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:09.627569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168231b-3fe2-44b2-b551-a8e1267ed07e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.627569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168231b-3fe2-44b2-b551-a8e1267ed07e None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.628734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 167/342] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:09.635041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.638119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.638407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.638685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.665132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:09.666965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:09.670085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:09.753966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f11a7-4fc3-4d95-975f-4b1b25956ccd None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:09.770441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:09.800916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:09.801798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.802293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.802714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.830395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 168/343] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:09.831322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.880220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:09.882072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.000948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a5c4-29bb-4be5-bd9c-861f6b6e6dc9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.006944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 176/344] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:10.018930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.045104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.086603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.087545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.089146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.089594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.090812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:10.090812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.092180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.119973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 169/345] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.126012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.131365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.170270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c93d0-ce0e-4412-b25d-448139674a36 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.219338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.220508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.221045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.221588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.223057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.225784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.230813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 177/346] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.235174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.295210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979821b-9680-4019-8aa3-8e8cf2592962 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.333183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.350746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d4c4-7e47-4387-bf3a-1cfa9c459b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.351371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d4c4-7e47-4387-bf3a-1cfa9c459b6d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.351651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d4c4-7e47-4387-bf3a-1cfa9c459b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.351925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d4c4-7e47-4387-bf3a-1cfa9c459b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.353477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0105d9-c8bf-4a06-bc5b-502fc7f8259a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.392421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11e35-84c8-4220-bcfa-3d169938a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.393434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11e35-84c8-4220-bcfa-3d169938a1ba None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.393918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11e35-84c8-4220-bcfa-3d169938a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.394408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11e35-84c8-4220-bcfa-3d169938a1ba None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.401721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11e35-84c8-4220-bcfa-3d169938a1ba None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.403590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11e35-84c8-4220-bcfa-3d169938a1ba None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.405975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 178/347] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.407607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e1dd-60d6-4e80-992e-f7cde7d812ac None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.408155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e1dd-60d6-4e80-992e-f7cde7d812ac None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.408639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e1dd-60d6-4e80-992e-f7cde7d812ac None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.410319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 179/348] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:10.411369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e1dd-60d6-4e80-992e-f7cde7d812ac None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.427976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d4c4-7e47-4387-bf3a-1cfa9c459b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.429105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d4c4-7e47-4387-bf3a-1cfa9c459b6d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.431195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.536426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e1dd-60d6-4e80-992e-f7cde7d812ac None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.537612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 170/349] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:10.538987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.539276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.539604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.561427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:10.562777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:10.578333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.579856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.580350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.580889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.593888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:10.599640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:10.600642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:10.601512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:10.604512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 180/350] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:10.605568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.616475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.644435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 171/351] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:10.645633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.678689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.738723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde776f2-55a4-43c8-8d4a-6027c421d555 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.758817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b19dc-b355-4539-8db9-3dfff9a88f7e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.778924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.779752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.780241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.780508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.781566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=3cda58b035334e8ca3c10df511347cbc) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:10.781870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.783416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.791285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 181/352] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.792576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.803494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.804422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.804888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.805311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.807259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.809867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.812381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 172/353] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.818514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.908325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.941267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d7482-f6c3-4f1d-9444-45f812cad9e4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.956769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b440-96a8-4a44-a11d-53495541406b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.957134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.980289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.981259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.981760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.982191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.983836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.985439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.988485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 173/354] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.994318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.013281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.013723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.014267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.014644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.015427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:11.015832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.021601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beff57d-d70c-4d5f-bc57-4b016848ec79 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.031883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 182/355] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.033502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56873-a06c-4950-b25c-91d9ba383f3e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.034175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56873-a06c-4950-b25c-91d9ba383f3e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.034607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56873-a06c-4950-b25c-91d9ba383f3e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.036463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 183/356] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:11.048828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.048828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.048828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.074502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:11.075833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:11.137761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002c0aa-df32-424a-9393-099045ad2902 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.163900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 184/357] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:11.164744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.182211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.183138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.183586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.184005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.185077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=3cda58b035334e8ca3c10df511347cbc) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:11.185599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.187290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.194390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 174/358] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=073ad24837f74fb6979813d89b0e171f => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.196248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.248756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.280102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.334487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e55ad-36d0-467b-a878-92f15a19e63c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.344073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f487f3-ad34-4d11-b91f-8c88cf3dc052 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.378608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.379340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.379625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.379901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.409655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.410397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.410685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.410958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.445106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:11.453451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:11.454468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:11.455252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 175/359] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:11.467366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.569776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.571303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.637822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.659197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6c115-c9d9-4fb1-81a2-367ee849deed None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.669135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.714865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.716320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.717278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.718076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.719750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:11.720582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.723817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8790d-61b3-432b-9eb6-008b7f1c6d81 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.726530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 185/360] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:11.727125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.741375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 176/361] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:11.744438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af22ef-85d8-4099-8662-288a8c1aa726 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.745121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af22ef-85d8-4099-8662-288a8c1aa726 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.747195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af22ef-85d8-4099-8662-288a8c1aa726 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.749054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 177/362] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:11.754110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af22ef-85d8-4099-8662-288a8c1aa726 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.893051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e497-05af-4f4d-86b5-eff9219c33fa None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.913964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af22ef-85d8-4099-8662-288a8c1aa726 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.956192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca62c-637d-4f02-9d8e-1216520d926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.957385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca62c-637d-4f02-9d8e-1216520d926b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.957976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca62c-637d-4f02-9d8e-1216520d926b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.958218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.958631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca62c-637d-4f02-9d8e-1216520d926b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.959086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.959458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.959823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.961087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.964324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.965987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 178/363] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.966864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.977333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dca62c-637d-4f02-9d8e-1216520d926b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-84dca62c-637d-4f02-9d8e-1216520d926b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:11.982638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:11.983593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:11.984375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:11.985031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 186/364] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:11.985791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.986069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.986341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.003183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.017888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:12.019582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:12.042742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.119789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889592e-ad99-4adc-b440-a613acbc56a3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.140194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 187/365] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:12.145616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.194784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.195434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.195710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.195978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] PATH_INFO: `/v3/users/eb4b3f488404418d9f11412fecc479dc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.197715 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4b3f488404418d9f11412fecc479dc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.199202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.201013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 179/366] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/users/eb4b3f488404418d9f11412fecc479dc => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.203552 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.296125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b7c87-aff2-49e4-b04c-dc4f17b23a2a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.337291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.337961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.338230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.338495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.339640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.341139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.343074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 188/367] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.343945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.379168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.437074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.455033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc984d0-23ea-4e98-a5f8-680d40cd1c66 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.526518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.527189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.527419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.527699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.528451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:12.528994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.533496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.550263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6e909-0dc9-4529-8f57-0d1ab7429604 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.552502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 180/368] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.553202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.604842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.605557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.605886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.606162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.606895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] RBAC: Adding query filter params (role.id=0abfc2c6435349d0837dfec95a55a0b2, user.id=eb4b3f488404418d9f11412fecc479dc, scope.system=all) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:12.607456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.609050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.622716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 189/369] 10.222.0.45 () {56 vars in 1308 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/role_assignments?user.id=eb4b3f488404418d9f11412fecc479dc&scope.system=all&role.id=0abfc2c6435349d0837dfec95a55a0b2 => generated 510 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.623568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.692065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c384ca-c302-4ae3-8629-f16a8b8e6a73 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.719483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.742604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.743261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.743820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.744099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.744860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=f3202b9808af44d3a1f42d456c93ddca) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:12.745326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.747392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.753182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07c7f-319a-47fd-aea4-ffcdc0fb4a1f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.754194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 181/370] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.757762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.807130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.819785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.820426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.820704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.821001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.924416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.926214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:13.011993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f03d95-baa6-4621-9727-f0f835d1e619 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:13.051968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:13.075574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:13.076154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.076436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.076711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.094469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:13.095868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 190/371] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:13.104047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:13.105045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:13.105846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 182/372] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:13.106559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:13.117797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:13.236149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96b43c-3128-4736-b6aa-85d576af53b8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:13.281288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:13.282965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.283247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.283524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.284702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:13.286186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:13.288002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 191/373] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:13 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:13.294782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:13.295893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:13.350334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:13.366729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12ecf-7ef9-47b6-9536-fbcf73fb4e11 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:13.436802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea455be-a17e-4248-bd18-b13912b48969 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:13.440137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:13.440773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.441056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.441318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.441989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:13.442288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:13.443692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:13.460462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 183/374] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:13.473887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:13.520519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:13.521195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.521476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.521751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.523575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:13.525641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:13.536014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 192/375] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:13 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:13.539874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:13.671297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf375e-0c2a-44ca-90c3-350de2149be9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:13.741935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87e1da-d5da-4910-a470-1b31dd30cba6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:13.744804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:13.745435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.745714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.745983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.766964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:13.778859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:13.822241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:13.823319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.823851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.824376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.825400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=f3202b9808af44d3a1f42d456c93ddca) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:13.826055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:13.832741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa08922-6d3c-4267-b66c-61f12f8ffbeb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:13.836212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:13.838307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:13.843188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 193/376] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:13 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=073ad24837f74fb6979813d89b0e171f => generated 260 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:13.922971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33365d-d7fc-4679-b88f-1aac7d5638bc None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.923257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33365d-d7fc-4679-b88f-1aac7d5638bc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.923450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33365d-d7fc-4679-b88f-1aac7d5638bc None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.925089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 194/377] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:13.931322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49265728-a92d-415c-8b63-1753ca143773 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:13.931659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49265728-a92d-415c-8b63-1753ca143773 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:13.931927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49265728-a92d-415c-8b63-1753ca143773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:13.955367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 184/378] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:33:13.956745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:13.985913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-49265728-a92d-415c-8b63-1753ca143773 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:13.987158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-49265728-a92d-415c-8b63-1753ca143773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:14.004109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:14.077425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d05dd-6c68-4f1a-87b3-cc7261b3336e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:14.129239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:14.130379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.130923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.131405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] PATH_INFO: `/v3/projects/3c95175d6f124287a997d11bfc5d0ce9` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.132985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] RBAC: Authorizing `identity:get_project(project_id=3c95175d6f124287a997d11bfc5d0ce9)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:14.135936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:14.140474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 185/379] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:13 2022] GET /identity/v3/projects/3c95175d6f124287a997d11bfc5d0ce9 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:14.148992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:14.152582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 195/380] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:14.270183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb67b0-8348-4246-9805-bd908571de34 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:14.278622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:14.315586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd01d-4406-4ca9-ac7f-ac6d7a2b469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:14.316504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd01d-4406-4ca9-ac7f-ac6d7a2b469a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.316969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd01d-4406-4ca9-ac7f-ac6d7a2b469a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.317384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd01d-4406-4ca9-ac7f-ac6d7a2b469a None admin] PATH_INFO: `/v3/groups/45e5002e086544c2b5604f8b52dc9931` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.324919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bd01d-4406-4ca9-ac7f-ac6d7a2b469a None admin] RBAC: Authorizing `identity:get_group(group_id=45e5002e086544c2b5604f8b52dc9931)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:14.326636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bd01d-4406-4ca9-ac7f-ac6d7a2b469a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:14.328829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 186/381] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:14 2022] GET /identity/v3/groups/45e5002e086544c2b5604f8b52dc9931 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:14.334676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49265728-a92d-415c-8b63-1753ca143773 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:14.355512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e11c-e5ce-415d-8332-93b4bdadff02 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.356030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e11c-e5ce-415d-8332-93b4bdadff02 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.356573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e11c-e5ce-415d-8332-93b4bdadff02 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.358743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 187/382] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:14.366283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.366769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.367189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.397842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:14.399304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:14.502246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49265728-a92d-415c-8b63-1753ca143773 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:14.520038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:14.537065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 188/383] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:14.537947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:14.578232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:14.578854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.579136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.579405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.580139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] RBAC: Adding query filter params (group.id=45e5002e086544c2b5604f8b52dc9931, role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=3c95175d6f124287a997d11bfc5d0ce9) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:14.580446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:14.582151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:14.591819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 196/384] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:14 2022] GET /identity/v3/role_assignments?group.id=45e5002e086544c2b5604f8b52dc9931&scope.project.id=3c95175d6f124287a997d11bfc5d0ce9&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:14.692424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:14.696481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46857db2-d3d8-407b-ab69-343d5d343232 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:14.744263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:14.744965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.745539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.745539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.762783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:14.767752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:14.768664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:14.769498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 189/385] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:14.775949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:14.922794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218bc31-73ba-4129-8fe2-db7b3369b2c3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:14.962615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:14.963882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:14.964498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:14.965143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:14.966007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:14.966519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:14.968102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:14.969497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:14.985166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 197/386] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:14.993244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:15.048705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:15.128433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29d02c-05b1-4f07-ba01-728e33825077 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.197737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6ce2-1a41-423f-b781-3ce626d6978f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.203548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.204197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.204474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.204757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.229190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:15.234526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:15.235485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:15.236284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 190/387] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:15.244771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:15.270871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.271894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.272443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.273019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.274437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:15.276418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:15.278916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 198/388] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:14 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:15.284010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:15.285104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:15.428803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3838-84a6-40d9-9dc0-258d4dcea6b3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.439301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:15.445797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60c4ed-f24f-482d-b80c-e99e0bae44d9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.488181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.489206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.490055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.490537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.491002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.491105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.491333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.491559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.492405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:15.494859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:15.495262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:15.496748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:15.497002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:15.498777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 199/389] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:15 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:15.505678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:15.508554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 191/390] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:15.514457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:15.645845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:15.676287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec4078-9fbb-42cb-8d31-304fd0d59917 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.688420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e8557-5f1d-48d9-a847-9a457fc85861 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.734137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d989b8-b3cd-4c45-be60-5a4d88de52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.734805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d989b8-b3cd-4c45-be60-5a4d88de52c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.735079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d989b8-b3cd-4c45-be60-5a4d88de52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.735350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d989b8-b3cd-4c45-be60-5a4d88de52c4 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc/groups/8a0820ae3299461da32ab00817cf34f2/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.739122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d989b8-b3cd-4c45-be60-5a4d88de52c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cda58b035334e8ca3c10df511347cbc, group_id=8a0820ae3299461da32ab00817cf34f2, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:15.741177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d989b8-b3cd-4c45-be60-5a4d88de52c4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:15.751382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bfd34-40ed-42ca-85c5-9381fa9a7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.752290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bfd34-40ed-42ca-85c5-9381fa9a7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.752290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bfd34-40ed-42ca-85c5-9381fa9a7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.752664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bfd34-40ed-42ca-85c5-9381fa9a7ac0 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.753800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bfd34-40ed-42ca-85c5-9381fa9a7ac0 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:15.755400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bfd34-40ed-42ca-85c5-9381fa9a7ac0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:15.757463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 192/391] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:15 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:15.761412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b322dca-e9ee-4bfe-97ba-5f1fbb546e60 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.761828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b322dca-e9ee-4bfe-97ba-5f1fbb546e60 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.761983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b322dca-e9ee-4bfe-97ba-5f1fbb546e60 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.763420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 193/392] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:15.765509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b322dca-e9ee-4bfe-97ba-5f1fbb546e60 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:15.768605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 200/393] 10.222.0.45 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:15 2022] PUT /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc/groups/8a0820ae3299461da32ab00817cf34f2/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:33:15.770913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.771403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.771749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.800561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:15.801989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:15.862385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:15.922023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b322dca-e9ee-4bfe-97ba-5f1fbb546e60 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:15.966302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 201/394] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:15.994106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:15.994696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.994971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.995241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.996466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:15.997968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:15.999953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 194/395] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:15 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:16.005851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.149327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6a52-eb32-4422-b2b3-51eb3db22220 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.194867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.195552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.195834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.196170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc/groups/8a0820ae3299461da32ab00817cf34f2/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.199271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] RBAC: Authorizing `identity:create_grant(project_id=3cda58b035334e8ca3c10df511347cbc, group_id=8a0820ae3299461da32ab00817cf34f2, role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.200754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.222774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 202/396] 10.222.0.45 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:16 2022] PUT /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc/groups/8a0820ae3299461da32ab00817cf34f2/roles/073ad24837f74fb6979813d89b0e171f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:16.374717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.396847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.490951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae6ab-6c19-4a1a-b149-5014dced1aad None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.526190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.526838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.527114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.527379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.539101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:16.545202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:16.547475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:16.549171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 195/397] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:16.552209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.573123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.687684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fdad6-7ccd-4c76-8b68-adce5b3c749b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.728352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509460b-f739-4741-908b-777819548b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.729180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509460b-f739-4741-908b-777819548b2f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.729459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509460b-f739-4741-908b-777819548b2f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.729732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509460b-f739-4741-908b-777819548b2f None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.730419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509460b-f739-4741-908b-777819548b2f None admin] RBAC: Adding query filter params (name=member) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:16.730721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509460b-f739-4741-908b-777819548b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.732411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509460b-f739-4741-908b-777819548b2f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.745974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 203/398] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:16.751791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.860181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.865626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a284d2-2a3a-42fa-8ae3-a5550626e3a2 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.866239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a284d2-2a3a-42fa-8ae3-a5550626e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.866239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a284d2-2a3a-42fa-8ae3-a5550626e3a2 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.867740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 204/399] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:16.878260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.878586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.878741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.896772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69c0f3-a8ab-489a-b0f3-e0a5659f41d3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.910802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:16.912007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:16.966212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.966770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.967042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.967312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.969742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.971187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.974407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 196/400] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:16.981406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.060410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 205/401] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:17.126142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10128d6b-47fc-4919-93a9-92734fae9493 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.161653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ddf12-6003-4100-836c-19eece88d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.162294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ddf12-6003-4100-836c-19eece88d899 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.162569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ddf12-6003-4100-836c-19eece88d899 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.162836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ddf12-6003-4100-836c-19eece88d899 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.163957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ddf12-6003-4100-836c-19eece88d899 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.165709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ddf12-6003-4100-836c-19eece88d899 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.167626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 197/402] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:17.173059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.186741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.310655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb8faf-46c7-443c-8800-0146f8e71bb9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.351740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e6396-6b32-4e0d-8359-6fcb89d10d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.353404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e6396-6b32-4e0d-8359-6fcb89d10d1b None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.353853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e6396-6b32-4e0d-8359-6fcb89d10d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.354129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e6396-6b32-4e0d-8359-6fcb89d10d1b None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca/groups/8a0820ae3299461da32ab00817cf34f2/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.356021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e6396-6b32-4e0d-8359-6fcb89d10d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=f3202b9808af44d3a1f42d456c93ddca, group_id=8a0820ae3299461da32ab00817cf34f2, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.357749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e6396-6b32-4e0d-8359-6fcb89d10d1b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.380624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 206/403] 10.222.0.45 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:17 2022] PUT /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca/groups/8a0820ae3299461da32ab00817cf34f2/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:17.391970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53910cc-32fc-47b6-a487-24bc68358611 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.391970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53910cc-32fc-47b6-a487-24bc68358611 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.391970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53910cc-32fc-47b6-a487-24bc68358611 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.392912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 198/404] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:17.398813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.399192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.399998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.419682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:17.420968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:17.499493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.506178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 207/405] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:17.597962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53910cc-32fc-47b6-a487-24bc68358611 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.621180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.725143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53910cc-32fc-47b6-a487-24bc68358611 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.771184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.771885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.772121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.772660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.787285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:17.792623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:17.793569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:17.794357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 199/406] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:17.799556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.861756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.005563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abe1d2-8ad2-4942-b48f-f8a7e606fc0e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.029650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.082122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b186286-758c-4030-8bb9-3fb601477042 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.087977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.088849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.089338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.089791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.090704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:18.095990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.097673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.116375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 208/407] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:18.124174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.154688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.155335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.155617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.155887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.177587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:18.185318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:18.186246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:18.187078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:18.197163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 200/408] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:18.209772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.233054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.299568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcecb0-313e-4c36-b86a-a0ce0ae5402e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.340648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a220219-1737-4d97-8836-f0c3f8737acf None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.370288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.371261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.371736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.372351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.373793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.375616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.377595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 209/409] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:18.377701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.382127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.382127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.382127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.382127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:18.382127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.382127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.383362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.385376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.392137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 201/410] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:18.398535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.516006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa0ca6-cee6-4ff6-8b99-c90222f35e0e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.554700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.555481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.555908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.556432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] PATH_INFO: `/v3/groups/45e5002e086544c2b5604f8b52dc9931` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.557674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] RBAC: Authorizing `identity:get_group(group_id=45e5002e086544c2b5604f8b52dc9931)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.559334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.561277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 202/411] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/groups/45e5002e086544c2b5604f8b52dc9931 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:18.566827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.638773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7e5b-7b1d-4d93-a4b5-f94583839460 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.669784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.680661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ee2fe-ec54-48a4-a122-06783678a09f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.693273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.700842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16f4fb-b55c-4d19-a71b-c793d853e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.701666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16f4fb-b55c-4d19-a71b-c793d853e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.702012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16f4fb-b55c-4d19-a71b-c793d853e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.702347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16f4fb-b55c-4d19-a71b-c793d853e7b2 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.703561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16f4fb-b55c-4d19-a71b-c793d853e7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.705375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16f4fb-b55c-4d19-a71b-c793d853e7b2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.712637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 210/412] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:18.714124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6b84-a596-474d-936d-20151d6c0cb0 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.714436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6b84-a596-474d-936d-20151d6c0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.714782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6b84-a596-474d-936d-20151d6c0cb0 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.716440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 211/413] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:18.717535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6b84-a596-474d-936d-20151d6c0cb0 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.723732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847adc4-b4f2-4eb5-8e68-576a261e0e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.724380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847adc4-b4f2-4eb5-8e68-576a261e0e98 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.724691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847adc4-b4f2-4eb5-8e68-576a261e0e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.732999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847adc4-b4f2-4eb5-8e68-576a261e0e98 None admin] PATH_INFO: `/v3/projects/3c95175d6f124287a997d11bfc5d0ce9` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.733827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847adc4-b4f2-4eb5-8e68-576a261e0e98 None admin] RBAC: Authorizing `identity:get_project(project_id=3c95175d6f124287a997d11bfc5d0ce9)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.735337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847adc4-b4f2-4eb5-8e68-576a261e0e98 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.737377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 203/414] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/projects/3c95175d6f124287a997d11bfc5d0ce9 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:18.747163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.747163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.747163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.765596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:18.767552 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:18.852707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 204/415] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:18.853476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6b84-a596-474d-936d-20151d6c0cb0 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.853639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.911592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.912181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.912459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.912742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca/groups/8a0820ae3299461da32ab00817cf34f2/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.923077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3202b9808af44d3a1f42d456c93ddca, group_id=8a0820ae3299461da32ab00817cf34f2, role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.924624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.951001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 212/416] 10.222.0.45 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:18 2022] PUT /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca/groups/8a0820ae3299461da32ab00817cf34f2/roles/073ad24837f74fb6979813d89b0e171f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:18.968163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:19.013328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194122-8f96-4d57-a16c-271428d02e23 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:19.051710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd213f-7af7-41d0-908a-f4ea7ed5f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:19.052387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd213f-7af7-41d0-908a-f4ea7ed5f8fd None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.052659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd213f-7af7-41d0-908a-f4ea7ed5f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.053004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd213f-7af7-41d0-908a-f4ea7ed5f8fd None admin] PATH_INFO: `/v3/projects/3c95175d6f124287a997d11bfc5d0ce9/groups/45e5002e086544c2b5604f8b52dc9931/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.055070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd213f-7af7-41d0-908a-f4ea7ed5f8fd None admin] RBAC: Authorizing `identity:create_grant(project_id=3c95175d6f124287a997d11bfc5d0ce9, group_id=45e5002e086544c2b5604f8b52dc9931, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:19.057301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd213f-7af7-41d0-908a-f4ea7ed5f8fd None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:19.075076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 205/417] 10.222.0.45 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:18 2022] PUT /identity/v3/projects/3c95175d6f124287a997d11bfc5d0ce9/groups/45e5002e086544c2b5604f8b52dc9931/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:19.204325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:19.271991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090bb1-71d1-451a-ad17-8eb3ca2c7948 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.272276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090bb1-71d1-451a-ad17-8eb3ca2c7948 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.272556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090bb1-71d1-451a-ad17-8eb3ca2c7948 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.274736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 206/418] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:19.280915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.281227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.281466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.288470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:19.305201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:19.306682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:19.342525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f9424-e692-441b-8619-47b147b9a0f7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:19.389404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:19.389935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.390304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.390720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.405934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:19.409204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 207/419] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:19.412796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:19.413693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:19.414473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 213/420] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:19.419817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:19.515809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:19.578001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc1c3-215b-47d7-b857-9b0a1ad73ab9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:19.629149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:19.630170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.630645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.631108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.631965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] RBAC: Adding query filter params (name=member) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:19.632457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:19.634585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:19.647994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 208/421] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:19.654706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:19.812566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080e5fb-9bdc-4275-adba-90a5c50a492b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:19.838504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:19.850179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:19.871542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:19.872592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.873085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.873545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.992551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:19.995895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.035600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c964f6-b084-47b8-945a-24e0ce036fea None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.066453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.113073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.115438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.115438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.115438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.137303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:20.142847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:20.143790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:20.144594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:20.153653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 209/422] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:20.162060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.213121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 214/423] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:20.215388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.239863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.352041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60d33-0199-4d2e-a141-f63564647c3d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.366860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8f917-d4ab-462b-af8b-f2ff8f7241b9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.393327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.394115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.394516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.394888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.395664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:20.396063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.397643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef18ae2-09d6-4703-9d97-7dc4b7baf2e5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.408268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 210/424] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:20.410711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3f22-c90d-44b3-b720-e8512b4502df None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.411171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3f22-c90d-44b3-b720-e8512b4502df None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.411592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3f22-c90d-44b3-b720-e8512b4502df None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.413600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 211/425] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:20.418403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3f22-c90d-44b3-b720-e8512b4502df None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.419446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191d3c-a954-47dd-a444-a2705e065e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.420058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191d3c-a954-47dd-a444-a2705e065e00 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.420348 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191d3c-a954-47dd-a444-a2705e065e00 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.420611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191d3c-a954-47dd-a444-a2705e065e00 None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.423557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191d3c-a954-47dd-a444-a2705e065e00 None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.425043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191d3c-a954-47dd-a444-a2705e065e00 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.432095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 215/426] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:20.433515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.434254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.434254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.453383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:20.454585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:20.467691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.540219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 216/427] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:20.541278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.557094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3f22-c90d-44b3-b720-e8512b4502df None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.579611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.629667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.630623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.631139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.631616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.726649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dbdd6-bbeb-45de-8ca7-8afcb3e9ce95 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.753991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.755793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.791873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.792905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.793411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.793882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.796146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.797834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.806343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 217/428] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:20.809208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.845090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.920366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.941112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b95d0e-3bda-4dcc-808d-0707f687e6d9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.941658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 212/429] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:20.942503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.988012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.988635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.988955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.989623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.991912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=3cda58b035334e8ca3c10df511347cbc) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:20.992259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.995637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.004935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 218/430] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:21.005979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.112442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b391a-b0bb-432b-b8d6-dc4abb12e779 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.205911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e412e-f77c-4f48-9355-021c259fb9b9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.221482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.222149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.222438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.222719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.231846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.245121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:21.249497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.250143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.250426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.250702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] PATH_INFO: `/v3/projects/3cda58b035334e8ca3c10df511347cbc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.251882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] RBAC: Authorizing `identity:get_project(project_id=3cda58b035334e8ca3c10df511347cbc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:21.252157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:21.253239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:21.254026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:21.254640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.255360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 219/431] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/projects/3cda58b035334e8ca3c10df511347cbc => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.257240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 213/432] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:21.261881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.263160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.287175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.403455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783e4c5-2296-4ad0-a918-2eb8118b6a4f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.413759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9feaa-1556-4d9e-a882-d085ca2f388c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.448855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.449866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.450372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.450850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.452231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.453934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.456157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 220/433] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.462024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.464203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.464869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.465151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.465424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.466164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] RBAC: Adding query filter params (name=member) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:21.466471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.469594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.487734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 214/434] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.495408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.565526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.580634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.593275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798499-c6af-49b7-a4b7-c03362943147 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.652759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.652759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.652759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.652759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.653169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=3cda58b035334e8ca3c10df511347cbc) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:21.653169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.653169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e5616-a99f-4ddd-b0cc-7a3372e7051c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.659014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff15f6-bcf3-4c8f-9d18-2e720ecd6792 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.660151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 221/435] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=3cda58b035334e8ca3c10df511347cbc&role.id=073ad24837f74fb6979813d89b0e171f => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.703507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.704158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.704483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.704700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.706416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce89e7-6078-4c58-ac88-c1db4c292a0e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.706658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce89e7-6078-4c58-ac88-c1db4c292a0e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.706908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce89e7-6078-4c58-ac88-c1db4c292a0e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.708678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 222/436] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:21.716196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90485-e826-4dee-8aec-4a8b15076f3c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.716648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90485-e826-4dee-8aec-4a8b15076f3c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.717197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc90485-e826-4dee-8aec-4a8b15076f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.741742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9dc90485-e826-4dee-8aec-4a8b15076f3c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:21.746175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9dc90485-e826-4dee-8aec-4a8b15076f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:21.812999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.814546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.844600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 223/437] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:21.846008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a27db2-8989-472e-ab2f-a22d18aa52ac None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.846297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a27db2-8989-472e-ab2f-a22d18aa52ac None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.846596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a27db2-8989-472e-ab2f-a22d18aa52ac None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.848155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 224/438] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:21.853920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.854239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.854481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.876314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:21.877055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:21.892030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.954439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 215/439] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:21.957820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 225/440] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:21.959928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.065383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924be6b-7f24-4ae6-9b78-2580f28c54f9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.100503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.101253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.101539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.101807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.103547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.105030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.107230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 216/441] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.112834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.131784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.137897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.172585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.247532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca027c9-67aa-4fcc-87e1-432470cc4c50 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.273687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ac1d-7858-4cf1-94d5-4591c35e2d15 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.283743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.284362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.284635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.284936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.286024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.287470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.289043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 226/442] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.290394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.308566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.309248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.309529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.309801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.319972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:22.325301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.326347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 217/443] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.327402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.381568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.403745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6dc45-1117-4b6f-89cf-f8ba69c1a7c5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.412356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.428248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd01d1-5136-418a-ba28-c7fa23a0a835 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.437971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.438612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.438893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.439304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.450008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:22.454780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.455756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:22.456551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 227/444] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.457232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.465578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.466189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.466510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.466784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.467503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=d92f4eb019b54a4183aaf372d9a066ab, scope.project.id=f3202b9808af44d3a1f42d456c93ddca) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.467809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.469274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.474925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 218/445] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=d92f4eb019b54a4183aaf372d9a066ab => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.475695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.568063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6458-47e2-4d2f-b09e-92acc1af27bd None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.595917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945a45-3218-4af5-a6ef-a804f15a4b85 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.608965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.609951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.610402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.610847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.611696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.612203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.613718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.616325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.629054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 228/446] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.630247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.639502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.640130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.640409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.640685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.641476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.641785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.643220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.654741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 219/447] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.660466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.677011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.756563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960c17-a726-4e0c-a018-4bf047040cbf None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.794397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3474e-23c3-4952-8a63-1e41f9678f48 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.797979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.798590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.799054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.799156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.832367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.832918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.833196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.833466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.878508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.882502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.883677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.911623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.913099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.926606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.987709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 229/448] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:22.994556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.016955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 220/449] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:33:23.022537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.090492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.094485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90303fe-8fd5-4a86-a457-8802cf7bd3f9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.132946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.133581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.133860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.134137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] PATH_INFO: `/v3/projects/3c95175d6f124287a997d11bfc5d0ce9` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.134736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413bf07-a3fc-4438-899f-6791585280f5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.135283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] RBAC: Authorizing `identity:get_project(project_id=3c95175d6f124287a997d11bfc5d0ce9)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.136771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.138425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 230/450] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/projects/3c95175d6f124287a997d11bfc5d0ce9 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:23.144014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.150447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.174746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.175380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.175658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.175933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] PATH_INFO: `/v3/projects/f3202b9808af44d3a1f42d456c93ddca` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.177082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] RBAC: Authorizing `identity:get_project(project_id=f3202b9808af44d3a1f42d456c93ddca)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.178518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.185255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 221/451] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/projects/f3202b9808af44d3a1f42d456c93ddca => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:23.186236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.247495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c6c5b-1e26-4d6e-9c0b-2192e9cfbffc None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.285720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.286378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.286610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.286880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] PATH_INFO: `/v3/groups/45e5002e086544c2b5604f8b52dc9931` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.287990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] RBAC: Authorizing `identity:get_group(group_id=45e5002e086544c2b5604f8b52dc9931)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.290015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.291018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204660e5-598e-49a1-ac13-8cea66178521 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.291571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 231/452] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/groups/45e5002e086544c2b5604f8b52dc9931 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:23.297328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.327116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.327750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.328525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.328525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] PATH_INFO: `/v3/groups/8a0820ae3299461da32ab00817cf34f2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.329415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] RBAC: Authorizing `identity:get_group(group_id=8a0820ae3299461da32ab00817cf34f2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.330873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.332469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 222/453] 10.222.0.45 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/groups/8a0820ae3299461da32ab00817cf34f2 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.332600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.339260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.388953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.403950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08990-055d-493b-bb53-4ae4f3116625 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.440296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.440928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.441210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.441482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.442211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] RBAC: Adding query filter params (group.id=45e5002e086544c2b5604f8b52dc9931, role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=3c95175d6f124287a997d11bfc5d0ce9) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.442522 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.442686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31115236-971c-4b4a-9b4f-be640ee0064d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.443981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4e1be-18c1-4483-9d7a-f22a5076f81e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.450100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 232/454] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/role_assignments?group.id=45e5002e086544c2b5604f8b52dc9931&scope.project.id=3c95175d6f124287a997d11bfc5d0ce9&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:23.481149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.481781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.482329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.482604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.483348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] RBAC: Adding query filter params (group.id=8a0820ae3299461da32ab00817cf34f2, role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=f3202b9808af44d3a1f42d456c93ddca) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.483657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.485196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a703bb1-b3b3-4db6-a1cc-28f3ea244e50 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.491842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 223/455] 10.222.0.45 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/role_assignments?group.id=8a0820ae3299461da32ab00817cf34f2&scope.project.id=f3202b9808af44d3a1f42d456c93ddca&role.id=073ad24837f74fb6979813d89b0e171f => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:26.326143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2ed4-3d45-4f63-a085-7bf81bc48f01 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.327234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2ed4-3d45-4f63-a085-7bf81bc48f01 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.327754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2ed4-3d45-4f63-a085-7bf81bc48f01 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.329756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 233/456] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:26.336194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb339b4-c763-49e3-81b5-c396e84f5cf3 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.337209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb339b4-c763-49e3-81b5-c396e84f5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.337690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb339b4-c763-49e3-81b5-c396e84f5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.370794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fcb339b4-c763-49e3-81b5-c396e84f5cf3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:26.373435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fcb339b4-c763-49e3-81b5-c396e84f5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:26.485385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 224/457] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:26.607160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794b8d0-8a4b-4a67-8f1a-9763a4886c4a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.607814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794b8d0-8a4b-4a67-8f1a-9763a4886c4a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.608292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794b8d0-8a4b-4a67-8f1a-9763a4886c4a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.610278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 234/458] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:26.615817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd74c86-a593-42b7-b681-6ee0fe24fdfb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.616350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd74c86-a593-42b7-b681-6ee0fe24fdfb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.616870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd74c86-a593-42b7-b681-6ee0fe24fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.645133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ebd74c86-a593-42b7-b681-6ee0fe24fdfb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:26.646680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ebd74c86-a593-42b7-b681-6ee0fe24fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:26.694642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:26.747030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 225/459] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:26.834623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794b8d0-8a4b-4a67-8f1a-9763a4886c4a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:26.973018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e225-18ab-4a03-b512-d9eace89dd63 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.973244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e225-18ab-4a03-b512-d9eace89dd63 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.973579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e225-18ab-4a03-b512-d9eace89dd63 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.974799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 226/460] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:26.996089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.996957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.997733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.020379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.038003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794b8d0-8a4b-4a67-8f1a-9763a4886c4a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.051245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:27.060379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:27.112636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.113302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.113580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.113849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.125445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.127166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:27.145909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:27.146878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:27.147738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:27.147738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.147738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:27.152390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 235/461] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:27.153356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.180447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 227/462] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:27.181294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.271528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69232f3-0b02-43cb-9191-33680f42521e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.313987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28212d5-2e25-4d9c-9cfd-c53ed6572e72 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.315818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.325553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.327083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.328403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.329168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.344470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.346810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.355865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.356480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.357189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.357525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.358233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:27.358594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.360137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-2be40448-34c4-47c9-8dbd-08f3ee93e59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:27.370561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:27.371532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:27.372431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:27.372431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.372431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:27.381033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 236/463] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:27.381033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210d4f-b270-4afa-aed0-bc5a54a36969 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.381033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210d4f-b270-4afa-aed0-bc5a54a36969 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.381033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210d4f-b270-4afa-aed0-bc5a54a36969 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.384496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 228/464] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:27.385348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.387371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 237/465] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:27.391798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.392069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.392335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.401281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.414516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:27.415727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:27.496535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 238/466] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:27.497740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.529860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ed016-3b54-4464-a500-9bcb97243f4e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.578145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.579106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.579578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.580066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.581026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:27.581521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.583122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.596604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 229/467] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:27.597772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.625681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.626862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5fd8a-7dcc-49f4-b491-9aa27ae1ae19 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.669829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.676304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.677225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.677515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.677788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.678447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.680653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.715249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 239/468] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:27 2022] POST /identity/v3/users => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:27.716583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.743508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ed75-611d-4ab8-a828-e4eabc61b059 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.815056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.815633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.815983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.816267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.829162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.830694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:27.850319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:27.851268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:27.852692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:27.852692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.852692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:27.854276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 230/469] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:27.860087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.881552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7987-5eb2-4051-94df-88df3cc5789c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.921557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.922181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.922464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.922738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.923394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.924961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.951382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.952369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 240/470] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:27 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:27.953312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.998754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66604f-c145-4b4c-830c-9f41108cd880 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.025547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.060074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.060899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.061183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.061499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.076135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.077773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:28.097099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.098114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:28.099527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:28.099527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.099527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:28.099527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 231/471] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.106118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.131566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b4cd4-1172-473f-8477-020794bcf195 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.179208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.179478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.179822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.180062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.180753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:28.182101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.183987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.210161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 241/472] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:28.215886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.270939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc22125-936d-4468-a7b0-93ed7ffeec71 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.310307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.328100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.329000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.329430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.329852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.330673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:28.331266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.333728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860a7ec-a239-43e2-b44c-1fc565a16725 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.350456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 232/473] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:28.352154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aed69-10bd-4d17-a538-6839575667a1 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.352447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aed69-10bd-4d17-a538-6839575667a1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.352853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68aed69-10bd-4d17-a538-6839575667a1 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.355525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 233/474] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:28.356092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fe5ec-c67a-4098-a556-3a22a208f1aa None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.358045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aed69-10bd-4d17-a538-6839575667a1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.363856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.407459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348473e4-9519-43d7-b08d-4ae3e86f3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.408240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348473e4-9519-43d7-b08d-4ae3e86f3b25 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.408586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348473e4-9519-43d7-b08d-4ae3e86f3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.409016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348473e4-9519-43d7-b08d-4ae3e86f3b25 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.409746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348473e4-9519-43d7-b08d-4ae3e86f3b25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.411305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348473e4-9519-43d7-b08d-4ae3e86f3b25 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.440982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 242/475] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:28 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:28.442967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.443617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.443996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.468306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:28.469956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:28.497118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68aed69-10bd-4d17-a538-6839575667a1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.571135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.572004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.572388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.572669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.573403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.576029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.613171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 243/476] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:28.633408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 234/477] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:28 2022] POST /identity/v3/users => generated 249 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:33:28.898548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.011670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.026117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a142585-69c4-4d9e-b80d-13f05b239bd9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.068410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.069061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.069340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.069611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.070809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.072435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.086009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.sql.core [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:33:29.086009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:33:29.086009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [parameters: {'id': 'ca9f19aac8f641bf8325e18f4cc6103a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:33:29.086009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88071) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application result.read() Oct 04 08:33:29.105055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:33:29.106591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application yield resource Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise self.value Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application session.commit() Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:33:29.108498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:33:29.110101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:33:29.111666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application result.read() Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:33:29.115569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [parameters: {'id': 'ca9f19aac8f641bf8325e18f4cc6103a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:29.122947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:33:29.125699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:29.142401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 244/478] 10.222.0.45 () {60 vars in 1131 bytes} [Tue Oct 4 08:33:28 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:29.142541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.189747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.296518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0ff4c-d1c6-4003-a42f-65ab98628ec0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.366712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b0db-01bf-4df1-813b-af034a71a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.368883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b0db-01bf-4df1-813b-af034a71a97f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.369362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b0db-01bf-4df1-813b-af034a71a97f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.369832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b0db-01bf-4df1-813b-af034a71a97f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.400686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3b0db-01bf-4df1-813b-af034a71a97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-54f3b0db-01bf-4df1-813b-af034a71a97f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:29.411338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:29.413014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:29.414592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:29.421649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 235/479] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:29.424461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.627426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77607af-5cc9-4ca0-8255-ab6d4c49f12c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.674433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.675400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.675889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.676347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.677229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.677745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.679324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dca80c-10fc-4424-9c54-f45f4f59154e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.692603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 245/480] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:30.847898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9cb81-ddcc-41dd-bb0a-5ff4131d1983 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.848983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9cb81-ddcc-41dd-bb0a-5ff4131d1983 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.849467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9cb81-ddcc-41dd-bb0a-5ff4131d1983 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.851259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 236/481] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:30.857189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a9e8-31d7-44ff-ae19-262b1e640eaf None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.858039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a9e8-31d7-44ff-ae19-262b1e640eaf None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.858534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a9e8-31d7-44ff-ae19-262b1e640eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.885728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-61b7a9e8-31d7-44ff-ae19-262b1e640eaf None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:30.887248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-61b7a9e8-31d7-44ff-ae19-262b1e640eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:30.899632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.974901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 246/482] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:31.011376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a13c-83d6-477c-b978-3985bd887785 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.011711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a13c-83d6-477c-b978-3985bd887785 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.011911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a13c-83d6-477c-b978-3985bd887785 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.013268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 237/483] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:31.030549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.030849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.031093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.061849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:31.063060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:31.161598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 247/484] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:31.304241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a13c-83d6-477c-b978-3985bd887785 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.419488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a13c-83d6-477c-b978-3985bd887785 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.421290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.469729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489292a0-8249-43f0-901c-90917fb00eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.470372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489292a0-8249-43f0-901c-90917fb00eac None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.470646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489292a0-8249-43f0-901c-90917fb00eac None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.470912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489292a0-8249-43f0-901c-90917fb00eac None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.494732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489292a0-8249-43f0-901c-90917fb00eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-489292a0-8249-43f0-901c-90917fb00eac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:31.499605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:31.500510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:31.501388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 238/485] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:31.507407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.532395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36295db2-024b-462a-88c5-037084929554 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.532973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36295db2-024b-462a-88c5-037084929554 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.533165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36295db2-024b-462a-88c5-037084929554 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.535079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 239/486] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:31.541683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.542001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.542233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.580450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:31.582084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:31.675898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.686405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 240/487] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:31.687399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.713352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68e727-c2f4-45c4-92de-dbec27062ed0 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.751687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.752304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.752579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.752867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.753648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:31.753978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.755428 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a7979-21be-4b1b-8008-4dc1897052aa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.764865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 248/488] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:31.766167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587db7d-9bf2-44ea-92cc-e5a4424cf7b6 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.766448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587db7d-9bf2-44ea-92cc-e5a4424cf7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.766723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587db7d-9bf2-44ea-92cc-e5a4424cf7b6 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.768159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 249/489] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:31.773876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6769147-0946-4075-82be-79a854032457 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.774280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6769147-0946-4075-82be-79a854032457 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.774562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6769147-0946-4075-82be-79a854032457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.792045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.798145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e6769147-0946-4075-82be-79a854032457 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:31.800001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e6769147-0946-4075-82be-79a854032457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:31.802633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b52d30-d257-4c6e-966d-f4c7a7cddf58 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.841705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.842342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.842621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.842999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.854781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:31.859919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:31.861521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 241/490] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:31.862412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.888167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 250/491] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:31.889229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6769147-0946-4075-82be-79a854032457 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.013370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.033650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5af1d-d854-4756-b170-e4293c57d8bb None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.053806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6769147-0946-4075-82be-79a854032457 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.079769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.080490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.080678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.080973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.094469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.096000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.098268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.099523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.099973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.100409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.103152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.103766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.105422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:32.116601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.117858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:32.118918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:32.118918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.118918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:32.119248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 251/492] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:32.120392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.124822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 242/493] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.125989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.138686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.252876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c861be-3f04-4200-8dcb-94daa41731a9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.254156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ffbf1-43c3-4042-8938-72a82da51a5d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.284738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.290635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.291268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.291542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.291808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.291927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.292639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.292947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.293221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.302926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.304249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:32.304420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:32.310751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.311642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:32.312483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 252/494] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.313185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:32.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.325603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:32.326528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:32.326528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.326528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:32.326528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 243/495] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.330172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.388569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.427033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e67e0-88bd-45a0-b29c-626fa3ac75ea None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.441243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d6e6-65a6-42fb-947c-204fc886ea72 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.464525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.465167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.465443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.465715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.466364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.466658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.468048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.480110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 253/496] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:32.480403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.480971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.481917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.482361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.482800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.495164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:32.500753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.501841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:32.502833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:32.505158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 244/497] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.506164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.540214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.595744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d364d76-09a5-4903-bd33-7683349f0933 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.615470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d7c9-356e-4f73-9626-cdb3fd45dda8 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.635290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.635895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.636172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.636442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.637048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.637159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.637544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.638830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.647261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 254/498] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:32.648834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.656912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.657558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.657807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.658079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.658726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.659024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.660398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.673052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 245/499] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:32.673870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.749253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc1753-35f8-4f7d-ac4d-d053345b1f6d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.762050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.775271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53dab-9d6e-4916-93da-9ee85b2c55b2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.784040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.784660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.784957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.785223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.793727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.795148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-87b4f9dd-dc22-4d69-ac92-88085e905941 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:32.808635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.809798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:32.810922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 255/500] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.811624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522dba1-b62b-470a-9a83-8ae890990286 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.811624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522dba1-b62b-470a-9a83-8ae890990286 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.811776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522dba1-b62b-470a-9a83-8ae890990286 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.812999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 256/501] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:32.813689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522dba1-b62b-470a-9a83-8ae890990286 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.816413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.817069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.817350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.817638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.818303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.818934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.820956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.829617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 246/502] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:32.830425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.872458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.923072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522dba1-b62b-470a-9a83-8ae890990286 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.936017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709efda2-42d4-4859-b586-b7ff8dc94c12 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.956891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.957515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.957793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.958061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.968926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.970414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.970990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.971729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.971901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.972348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.980284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.982044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:32.989209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.001201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:33.003087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:33.003087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.003087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:33.003087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 257/503] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.003087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-52fe54f7-7df8-46f7-87af-c0ffc53f3ec0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:33.004540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.007288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 247/504] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.009499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.011118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.024072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.028523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:33.029780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:33.097955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 248/505] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:33.098711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.099189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe4804-a32c-4ab4-a4c6-1f879e6651ad None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.144093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.152955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.153568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.153870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.154148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.155005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:33.155324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.156899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.203994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 258/506] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:33.204685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.223564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7820e8-e2fc-49b0-b7c5-acdaa4902c4c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.265317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.265971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.266259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.266531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.277827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.279303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:33.295810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.296963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:33.297848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:33.297848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.297848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:33.297848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 249/507] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.298120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.310767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.332140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b745c-b3c1-4b28-9340-a314b83a1104 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.372524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.373144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.373427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.373704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.374551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:33.374854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.376459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.390703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 259/508] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:33.391593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.393044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.415054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f8887-b3f2-4911-8119-a67fa5597ac8 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.450086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.450697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.450969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.451237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.451962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:33.452260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.453739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.493501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 250/509] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:33.494371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.496381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137dc3-e584-4c88-9b5a-5cf8d6269d1d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.536357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.537013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.537298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.537564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.550700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.599475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b683fa1-0b57-499d-b8b2-c0400848e53c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.612290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.613807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.637392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.637925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.638213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.638486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.639354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:33.639461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.640847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.647449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.654070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 251/510] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:33.654945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.714661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 260/511] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:33.715398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.760069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.762093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a9c47-d564-42e8-a014-498bdd79ade2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.795885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.796573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.796901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.797175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.808883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.810332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.818812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94145fac-0378-43df-8130-cbcd5783d252 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:33.824224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.825202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:33.826046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:33.826046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.826046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:33.826046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 252/512] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.826276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.854834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.855471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.855749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.856022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.864166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.865620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:33.878104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.879102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:33.880835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:33.881464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.881870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 261/513] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.881870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.938068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7451e9-a2cc-419a-9096-d6b77ddfc866 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.973016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.973767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.973906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.974158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.988001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801231-d31b-4f9a-bb34-e702ae1909c8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.989664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.028462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.029135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.029414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.029688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.037932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.039729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:34.052433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:34.053463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:34.055095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:34.055902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.055976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 262/514] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:34.056041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.056115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.110693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.171317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 253/515] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:34.172174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.175829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9b388-ff0e-46ed-8264-aec3b9a4ce40 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.209195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.209726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.210001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.210271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.221438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.222891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:34.238303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:34.239278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:34.240131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:34.240131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:34.240131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:34.240131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 263/516] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:34.240354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.260703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.273771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa857f-1246-41e3-bec6-aa5fed1803ca None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.309559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.310178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.310459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.310729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.311375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.311674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.313085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.325419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 254/517] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.327075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.339903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.351119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856a21-4005-4fa2-884b-58a88dd4bcc9 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.386413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.387024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.387303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.387578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.388321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.388629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.390128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.408731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 264/518] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.409614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.431372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46602e-bdd9-4ef5-8d6c-66ded33f854f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.466912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.467533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.467806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.468080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.468831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.469133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.470557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.483220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.493173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 255/519] 10.222.0.45 () {56 vars in 1139 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.493173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.514347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d66c-e41d-4478-b251-f49532677d7a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.547744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.548410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.548694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.548992 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.560220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.560950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.561786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:34.576627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:34.577783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:34.583535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:34.583535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:34.583535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:34.583535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 265/520] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:34.583535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.597243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc0f0-b47c-472d-9bfc-efc1614894a0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.631917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.632345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.633240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.633512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.634153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.634455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.635827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.647031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 256/521] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.647853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.682713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4975b3-2011-4b97-b4f5-2c90ae7beca0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.706794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.717849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.718372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.718649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.718919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.719565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.721048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.744445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 266/522] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:34 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:34.745272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.756374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec7a05-56ba-4b2e-9a39-b8ea2bc4b1a6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.792372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.802485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.803126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.803407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.803681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.873328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ad924-8e90-4564-a615-0752f3c0190a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.891995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.893611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.915207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.915834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.916106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.916375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.983219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.015812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.018488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.030861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 257/523] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:35.031643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.065734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.154894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76584e65-824d-4228-875f-d72715dc0588 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.159899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 267/524] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:35.159899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.197775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.198487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.198825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.199159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.199871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.200233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.201712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.214676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 258/525] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.215523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.252595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.273784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1b615-2b28-42ee-82a9-3f3b7737147c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.313018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.313664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.314220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.314500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.322678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.323102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.324224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.337169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db60f6-9bba-4377-9505-9918eb979ba0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:35.337876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.338682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:35.339544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 268/526] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.340015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.380787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.381425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.381704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.381971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.394185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.395874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:35.412092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.413383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:35.414977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:35.414977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.414977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:35.420701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 259/527] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.420701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.451169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362f59-e673-46a0-b460-cee5c3978b42 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.488233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.488946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.489179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.489447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.499801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.501822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.503513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:35.519061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.520044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:35.520920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:35.520920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.520920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:35.520920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 269/528] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.521726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.533357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a19b29-6a6c-4eca-981e-129204eed994 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.571829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.572874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.573223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.573567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.581070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.582594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.585306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:35.596576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.597521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:35.598368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:35.602732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 260/529] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.603420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.640753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947380cb-7140-4b20-a256-a66c7fcfe042 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.677273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.677877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.678156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.678429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.679126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.680311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.681796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.705735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 270/530] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.705735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.721908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea2e1-cbb2-457b-8db4-6a6e58be0067 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.765773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.766767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.767282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.767810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.768983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.769563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.771368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.779942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.786143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 261/531] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.791921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.847037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb4ae-cb50-4b1d-be44-2bef49b9ce27 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.858554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.907531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.908124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.908398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.908666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.909338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.909636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.911031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.913067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564fc4-6c45-4db1-95a6-c3886fae7532 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.923219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 271/532] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.924058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.965781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.966407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.966689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.966963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.967664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.967996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.971346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.003645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 262/533] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.004330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.049199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de0dd-84f0-4d4a-a057-7d289252bc8e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.082378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.120057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.120687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.120992 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.121267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.122122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=464a6f0e27d642efb036de9164eeefc9) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.122325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.123810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.134023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 272/534] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/role_assignments?user.id=464a6f0e27d642efb036de9164eeefc9&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.134998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.151584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27b17-d488-4515-a7cd-4715fc044ce6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.185758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.205480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.206955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.207395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.207815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.219245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.221628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:36.238108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:36.239210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:36.240235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:36.244362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 263/535] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:36.253813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.281502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeeb62-eb90-4e0e-aeda-68968936a847 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.325169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.326492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.326492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.326492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.340176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.342071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:36.354918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:36.355960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:36.357300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:36.361123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 273/536] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:36.362089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.380334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9818-c22e-4bf3-ae7a-fa70a5f14d73 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.408556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.420169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.420816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.421098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.421368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.422092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=cc2459051d2b42ad8a9c4d51568d2c09) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.422397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.423987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.430897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 264/537] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/role_assignments?user.id=cc2459051d2b42ad8a9c4d51568d2c09&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.431726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.531120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.558520 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8c3f1-febd-44c5-a825-5a48d01a7820 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.617297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234391c-e2b7-4dbf-b811-0ac2f9c82d89 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.654351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.655171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.655454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.655725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.656231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.656421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.656745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.656931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.657156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.657428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.658125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.658296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.658446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.659874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.673752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 274/538] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.684949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.694003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 265/539] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.700666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.862574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.879076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f257e-db9d-4650-bb33-5e4f43399116 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.880519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fa65-b984-4d46-8c95-408b3f9b0c12 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.884213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.924683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.926132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.926605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.927874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.928861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=4b448cdeede24aa9bb0fc1a9f210b53f) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.931072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.932805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e567bcb-9e33-40fa-9536-b9e9d9413ead None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.939301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 266/540] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/role_assignments?user.id=4b448cdeede24aa9bb0fc1a9f210b53f&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.970753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.971392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.971677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.971944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.972701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=511d91463bbf43ef878a3111e4c11b73) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.973037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.974543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2975a7-0232-4735-8af4-1e334159eac8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.981908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 275/541] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/role_assignments?user.id=511d91463bbf43ef878a3111e4c11b73&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:37.157306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c5a5-31db-417c-b761-9eb9ab13c47f None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.157914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c5a5-31db-417c-b761-9eb9ab13c47f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.158413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648c5a5-31db-417c-b761-9eb9ab13c47f None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.160201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 267/542] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:37.168745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.169265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.169369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.190871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:37.192120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:37.286973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 276/543] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:37.700279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c5a5-31db-417c-b761-9eb9ab13c47f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.841944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648c5a5-31db-417c-b761-9eb9ab13c47f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.881725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.883455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.884068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.884542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.896043 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:37.902028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:37.902923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:37.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:37.906302 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 268/544] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:37.912349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.016168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.028711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f259d27-c292-4d3e-a4c5-4963c9a9323b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.073673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.074695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.075191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.075675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.076529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.077049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.078632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.087865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 277/545] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.093879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.128130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.208273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b879acd-6da5-4a85-8184-bab895516085 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.244328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.244991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.245272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.245543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.256638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.258687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:38.274281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:38.275213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:38.276058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:38.276058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.276058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:38.276058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 269/546] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:38.281325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.393215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5cfc0-86e1-44f6-ae2d-f94bb636ce62 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.446417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.447034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.447312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.447581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.448224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.448526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.449999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.466914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 278/547] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.472683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.562237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.583182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3f90a-a988-456f-80c7-e0593a1b86b5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.620299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.620964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.621243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.621512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.629541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.631057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:38.643060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:38.644819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:38.646306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 270/548] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:38.651053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.670464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.780016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33c0b1-4042-4b14-bed3-ff17be84b9d5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.815560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.816087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.816364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.816697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.817460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.817814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.819258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70cbcd-9a82-4eac-9a16-1f1ab2123a80 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.839061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 279/549] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.844704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.955226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778ea17-ef38-4cf6-914b-49c6d75cbff7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.994250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.994880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.995162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.995436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.008780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.049767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d880-62b2-46fe-9fb7-d8056ece2f25 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.050061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d880-62b2-46fe-9fb7-d8056ece2f25 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.050312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d880-62b2-46fe-9fb7-d8056ece2f25 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.051750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 280/550] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:39.060068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc8d97-4de8-403f-ae7b-a831d44a4833 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.060354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc8d97-4de8-403f-ae7b-a831d44a4833 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.060625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc8d97-4de8-403f-ae7b-a831d44a4833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.091870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.093290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.095854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a9bc8d97-4de8-403f-ae7b-a831d44a4833 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:39.097073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a9bc8d97-4de8-403f-ae7b-a831d44a4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:39.188327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.196577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 281/551] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:39.197942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b9d0-416b-440a-be6b-d747800f0fca None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.198232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b9d0-416b-440a-be6b-d747800f0fca None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.198508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b9d0-416b-440a-be6b-d747800f0fca None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.200760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 282/552] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:39.211511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.211511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.211511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.254464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:39.258588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:39.261084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 271/553] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:39.266680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.331000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.427831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 283/554] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:39.446700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64b034-f26f-46ad-8d14-41ef7a807dd9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.483052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.483399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.483963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.484246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.484539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.499207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.501480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:39.519601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:39.520659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:39.521613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:39.521613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:39.521613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:39.521613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 272/555] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:39.531752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.662630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba239e-4075-4f41-9aa4-6cabbc6a5f75 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.717822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.722973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b4709-ff46-4c55-8dfa-2b9046aaa828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.723604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4709-ff46-4c55-8dfa-2b9046aaa828 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.723884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4709-ff46-4c55-8dfa-2b9046aaa828 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.724136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b4709-ff46-4c55-8dfa-2b9046aaa828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.725794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.743898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4efaa-d75c-49b4-9208-049fe383b8b5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.745885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b4709-ff46-4c55-8dfa-2b9046aaa828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-313b4709-ff46-4c55-8dfa-2b9046aaa828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:39.752936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:39.753884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:39.754721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 284/556] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:39.755895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a694f1-970a-4de0-ac5e-4b810974014e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.755895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a694f1-970a-4de0-ac5e-4b810974014e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.756166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a694f1-970a-4de0-ac5e-4b810974014e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.758833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 285/557] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:39.763210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a694f1-970a-4de0-ac5e-4b810974014e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.794890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.796065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.796234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.796563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.797157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.797461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.798874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572d36a-6b64-45f0-bfdb-a091022ba404 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.812115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 273/558] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.813232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.813517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.813793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.832545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:39.833785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:39.878021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a694f1-970a-4de0-ac5e-4b810974014e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.906583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 274/559] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:39.907424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.914353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.914960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.915405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.915673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.916326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.916624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.918139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.926118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 286/560] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.926908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.986983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.998772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.020108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc708d-e7c3-4152-a109-0e030e9a72b6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.038061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94784c1-7020-4aa7-975f-acae543aa6e6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.057519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142d4db-4086-49e1-861e-37e8b7317d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.058144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142d4db-4086-49e1-861e-37e8b7317d39 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.058474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142d4db-4086-49e1-861e-37e8b7317d39 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.058686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142d4db-4086-49e1-861e-37e8b7317d39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.069199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142d4db-4086-49e1-861e-37e8b7317d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:40.073731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e142d4db-4086-49e1-861e-37e8b7317d39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:40.074161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.075046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:40.076599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:40.077509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.077509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.077509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.077697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 275/561] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.077697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b9b0b-d255-4b3e-a761-1362cfdad297 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.077697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b9b0b-d255-4b3e-a761-1362cfdad297 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.077697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b9b0b-d255-4b3e-a761-1362cfdad297 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.078528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 276/562] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:40.081499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b9b0b-d255-4b3e-a761-1362cfdad297 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.082562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.084018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:40.097266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.098222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 287/563] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.099119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.197105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b9b0b-d255-4b3e-a761-1362cfdad297 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.218910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dc574-30a2-4dfb-a812-5e8c05d2b1dd None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.232005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.232645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.232952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.233223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.234392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.243520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.244951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.246854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.255976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.256576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.256888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.257191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.257847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.258146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.259511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-8de73f9f-b1de-4b08-a62a-aedb38506831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:40.261121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.262513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:40.263450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:40.263450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.263450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:40.263450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 277/564] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.263450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.263732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.263885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.272653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 288/565] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.274054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.282098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:40.283298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:40.350475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 278/566] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:40.351826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.385556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b63932-ab58-468b-bfe7-fe571e724133 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.422353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.422953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.423250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.423498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.424182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.424482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.425939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.442703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 289/567] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.442703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.463599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe0c54-2e76-460d-ad60-ad6f84b95a22 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.479334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.490262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.503094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.503993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.504449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.504750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.516488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:40.521324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.522259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 279/568] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.553790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ecf88-2203-4828-86b1-ca26e24cd4ec None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.589627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.590574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.590849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.591118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.591750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.592041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.593449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.609715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 290/569] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.609715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.637438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f166f1-a71b-496f-a69a-aa3de953787b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.671587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.672209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.672483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.672774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.683704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.685168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:40.700004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.705971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:40.707172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:40.707172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.707172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:40.707172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 280/570] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.707456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.707554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.710623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ba387-f4a7-4879-8a23-b739032bfa19 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.735639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.745365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.745993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.746270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.746534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.747253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=763cd7c148d24a679cc2a51a4edfcfa4) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.747552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.749052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.754332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 291/571] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/role_assignments?user.id=763cd7c148d24a679cc2a51a4edfcfa4&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.755058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.821696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eafd3-e92d-40bf-b219-43afe1c386be None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.866980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.867608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.867894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.868172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.868891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.869197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.870612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.876444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd948d8-7496-47f8-9cc4-2efc14b96b5f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.879718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 281/572] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.880786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.918759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.919412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.919690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.919962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.928229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.930739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:40.944758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.953803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 292/573] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.955063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.970255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.004441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.009489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e164e3-e082-4808-8b3b-9fae29f9e083 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.045734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.046388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.046667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.046937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.059962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:41.065195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.066117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:41.070184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:41.070823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac95d7c-c097-4988-a984-deeef4d678bf None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.070906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 282/574] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.070906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.108650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.109286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.109659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.109826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.110478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.110779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.112159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.126958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 293/575] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.127648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.188893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141639-6dfc-4e8f-8e42-6604e51cac53 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.213356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.227156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.228040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.228757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.229036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.239060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1b831-c7c0-4b45-ad9d-4b19ab540d11 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.241585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.243166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:41.259811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.260796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:41.262149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:41.262149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.262149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:41.262149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 283/576] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.262149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.278167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.282610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.283220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.283570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.283760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.284489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.284828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.286233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.305159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 294/577] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.306061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.381190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912214e9-22d4-464f-a2e7-2374200a74c3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.410797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107171d0-94f4-4e8d-8fd0-762b69bb1252 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.417246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.417854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.418129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.418396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.419169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.419470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.420974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.430541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 284/578] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.431707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.455521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.456233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.456504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.456805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.459735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.466729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.468219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:41.481219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.482695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:41.483796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 295/579] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.485998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.513423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.545078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500a823-37fa-41fd-b826-40fb06076346 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.581303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.582003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.582278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.582657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.583285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.583580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.584962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.597318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5313d-c850-431e-b1c8-b2b77f32ec7b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.603837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 285/580] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.603837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.638708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.639092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.639367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.639634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.652378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.653942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:41.670126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.671310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:41.672863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:41.672863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.672863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:41.672863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 296/581] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.672863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.716827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c793-1187-4784-aef2-9dd6cfb0489f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.724735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.747247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.754734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.755856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.756134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.756406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.768843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.770285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.782080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd3f1a-04f4-443b-8f68-e5a0db5462d5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:41.785287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.786247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:41.787209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:41.787209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.787209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:41.787209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 286/582] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.787850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.823617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.824226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.824597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.824808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.825544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.825855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.827299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.849994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 297/583] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.849994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.901256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c8d17-ce6d-4e80-84c0-bb6600e7300b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.939893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.940620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.940992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.941328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.949801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.951346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.952986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db5a9-2792-4c50-b185-f7d977f96dc0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.962544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:41.963854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.965208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:41.966465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:41.967455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 287/584] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.972705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.995626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.996249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.996572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.996829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.997471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.998032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.999150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.011707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 298/585] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.016957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.024280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.083952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239efc-294f-4bdb-823f-9f93220b116d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.125228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.125787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.126075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.126351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.127001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff4a3-21fa-470a-ba24-477c2ad78779 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.127118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.127297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.128689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.146642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 288/586] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.147683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.164945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.165872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.166253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.166629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.179630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.181118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:42.195240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.200900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:42.202045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:42.202045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:42.202045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:42.202045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 299/587] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:42.202045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.219265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.266168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5012-bef2-40fc-8096-4d0620d73ab2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.268643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.304811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.305411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee024-7757-4ebf-9949-042fe9fa4906 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.305532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.305855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.306193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.306987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.307358 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.308882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.332106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 289/588] 10.222.0.45 () {56 vars in 1139 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.332847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.340235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.340977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.341318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.341651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.348524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.350068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:42.361621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.362708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:42.363723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 300/589] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:42.364225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.446819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.449332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaedec-6768-45c7-8dcf-5ef8bd074a6c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.472880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8ea57-d96f-48ba-b07e-1d228710d0d6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.486210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.487049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.487334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.487613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.496056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.497535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.509383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:42.510137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.511219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:42.512441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:42.513261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.513679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.514084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.514860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.515308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.515912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 290/590] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:42.516751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.517310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.535424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 301/591] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.535424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.549726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.637761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c3ec-7b35-4891-9bb4-bb4aeec03cef None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.638371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555b38-9947-4384-9733-6f3cf718b9d0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.674387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.675003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.675286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.675562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.676262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.676568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.678137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.683245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.683876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.684162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.684431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.685846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.696983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 302/592] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.696983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.702371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.703838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:42.723818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.725077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:42.731680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:42.731680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:42.731680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:42.731680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 291/593] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:42.731680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.797859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669168a7-25d9-4fe7-9099-440b05bf88fa None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.815299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.835137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.836044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.836321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.836595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.837569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.838274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.839791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.845138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442fce-7127-4085-8bec-3663cd5117fd None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.860231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 303/594] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.861590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.891396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.891942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.892222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.892493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.899564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.901023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:42.912319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.913340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 292/595] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:42.914235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.930712 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.975391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95293e-b7e2-4492-95ad-300e4ba994d6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.013305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.014122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.014402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.014671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/464a6f0e27d642efb036de9164eeefc9/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.023853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7eb3-a9b8-45a6-a251-de4618edf5fc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.028907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=464a6f0e27d642efb036de9164eeefc9, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.030351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.042900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 304/596] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:42 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/464a6f0e27d642efb036de9164eeefc9/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:43.043716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.063775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.064512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.064911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.065824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.066317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.066620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.068078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.070586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.084642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 293/597] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.085712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.173488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d315d9-3c8a-41b1-a069-e4d796e42f46 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.183829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.213971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ff45a-c3f1-4d7d-9ffc-071d495d72a0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.216772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.217417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.217725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.217999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.231822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.233487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-adfe7087-94e0-4cf3-bf11-00701ff255c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:43.251565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:43.252662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:43.253670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:43.253670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:43.253670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:43.253670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 305/598] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:43.254079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b0775-daa4-4e8e-ac61-bd1d660d4412 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.254366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b0775-daa4-4e8e-ac61-bd1d660d4412 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.254638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b0775-daa4-4e8e-ac61-bd1d660d4412 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.260569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 306/599] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:43.260569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b0775-daa4-4e8e-ac61-bd1d660d4412 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.273918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.274589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.274841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.275117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.275842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.276128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.277633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.291428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 294/600] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.297290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.357728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.389705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b0775-daa4-4e8e-ac61-bd1d660d4412 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.406646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bb312-45fb-4099-b91a-78504df4f704 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.426472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.427013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.427296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.427568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.435730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.437298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.445153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.445768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.446045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.446315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.446962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.447263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.448614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e673c78-2a37-4628-8dcf-180b62b88cdb None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:43.451466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:43.453105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:43.454750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:43.461503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 295/601] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.461958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 307/602] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:43.462725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.463147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.463278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.463474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.482293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:43.483664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:43.487903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.556701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 296/603] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:43.557972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.597718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f51b2e-7ba9-4e0d-a0f4-da8241f1bf76 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.622514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.644903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c9307-3d12-405a-b147-74e14963654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.645641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c9307-3d12-405a-b147-74e14963654a None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.645980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c9307-3d12-405a-b147-74e14963654a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.646333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c9307-3d12-405a-b147-74e14963654a None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/cc2459051d2b42ad8a9c4d51568d2c09/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.663749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c9307-3d12-405a-b147-74e14963654a None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=cc2459051d2b42ad8a9c4d51568d2c09, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.666169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c9307-3d12-405a-b147-74e14963654a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.688892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 308/604] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:43 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/cc2459051d2b42ad8a9c4d51568d2c09/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:43.690114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c9307-3d12-405a-b147-74e14963654a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.696869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b068-cff2-4b3b-8070-9ab775f1d69a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.768767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.769724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.770186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.770610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.772916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.774228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.775897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.804664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 297/605] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.808208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.837010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.892113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c9307-3d12-405a-b147-74e14963654a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.934056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.934973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.935405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.935840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.943671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.945525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.954452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6c231-e537-4bcf-b812-836493c342dc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.957443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:43.959284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:43.960703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 309/606] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:43.962282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:44.012777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.014399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.014886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.015338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/4b448cdeede24aa9bb0fc1a9f210b53f/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.032680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=4b448cdeede24aa9bb0fc1a9f210b53f, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:44.034942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:44.053603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 298/607] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:43 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/4b448cdeede24aa9bb0fc1a9f210b53f/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:33:44.054815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:44.145152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60995c82-7d8b-417f-8724-9c58e2150aba None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:44.200589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:44.227064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.228101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.228583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.229085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.245039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d22f8-b9ff-454e-b2f8-27c802c7c85f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:44.261026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:44.271942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:44.273062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:44.274082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:44.276353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 310/608] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:44.282407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:44.312069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.312791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.312989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.313262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.313960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:44.314426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:44.315693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:44.329926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 299/609] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:44.337551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:44.359765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:44.419122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99349-9a43-4d0c-a150-a3e3deebd5b4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:44.460470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.461249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.461526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.461800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.462467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:44.462775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:44.465068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:44.467996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e905c57-6189-48c5-b3b9-1a3cf2fcf958 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:44.478576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 311/610] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:44.485851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:44.525321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.526428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.526911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.527414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/511d91463bbf43ef878a3111e4c11b73/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.549353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:44.551658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=511d91463bbf43ef878a3111e4c11b73, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:44.553521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:44.574917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 300/611] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:44 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/511d91463bbf43ef878a3111e4c11b73/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:44.648243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6260379-6c6e-4f9a-bec7-7c624f173911 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:44.696703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.697830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.698359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.698832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.716495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:44.718427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:44.741123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:44.742886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:44.743788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:44.743788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:44.743788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:44.743788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 312/612] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:44.750969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:44.844305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:44.891004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ceab-cd5a-450a-8ebf-550006b7d286 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:44.929656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:44.930373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.930769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.931116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.931887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:44.932258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:44.933774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:44.952885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 301/613] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:44.955200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.091426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373b869-6c95-4113-8af3-3b4b107eb2a7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.093005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:45.150163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.150800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.151081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.151359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.165132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:45.166746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:45.190214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:45.191232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:45.192181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 313/614] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:45.198313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.367957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f84f5-d604-44dc-8cd4-0c4530685b3a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.406008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:45.419762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.420394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.420673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.420974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.421721 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:45.422024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:45.423476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cbc7f-cae9-4069-936b-e34c31bc5799 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:45.452133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 302/615] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:45.457717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.538995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1043-90a6-4c77-b6ef-b5c48673a6d7 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.538995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1043-90a6-4c77-b6ef-b5c48673a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.538995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1043-90a6-4c77-b6ef-b5c48673a6d7 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.540541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 303/616] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:45.563518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.563813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.564005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.602124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:45.603342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:45.617409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63370c3b-1719-49c5-a9a3-23e2453315e7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.660460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.661796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.662076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.662350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.686685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:45.688218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:45.715467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:45.716487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:45.717420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:45.717420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:45.717420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:45.721997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 314/617] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:45.726124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.744875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 304/618] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:45.753634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:45.862163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48eb96-61b2-42a8-a1a2-64a62c0c9df8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.911188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.911715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.911994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.912265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.913008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:45.913339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:45.914774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:45.932864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 315/619] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:45.937985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.057162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa7657-165d-486d-ba4e-b568b7b1d440 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.073789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.098007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.102491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.103131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.103411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.103680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.116756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.116756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:46.125351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.126291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:46.127191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 305/620] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.134360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.250408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.281627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3782646-ba96-469a-b53b-3719c0e3591b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.323381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.324030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.324308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.324580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.336660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:46.337449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4d0a5-70fa-4635-8dce-3eea6684ea97 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:46.342839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.343853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:46.344765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 316/621] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.357179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.397525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.398349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.398638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.398917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.399634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.399947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.401432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.415454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 306/622] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:46.425754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.463329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.492900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda74-80a5-40d6-b417-436168bedd17 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.539086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.539989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.540342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.540739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.541491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.541865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.543970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39cbaf-6ed6-4958-93e4-118ffa7b1b4c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.546144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.562474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 317/623] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:46.562474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb6226-c8a7-4f3b-84c8-5321a0fde01a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.562474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb6226-c8a7-4f3b-84c8-5321a0fde01a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.562474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb6226-c8a7-4f3b-84c8-5321a0fde01a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.562474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 318/624] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:46.563569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb6226-c8a7-4f3b-84c8-5321a0fde01a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.565526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df023b16-4e54-4000-8202-259e0e722bab None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.610069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee4ef-46b9-40f0-885a-5d3faa78d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.610782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee4ef-46b9-40f0-885a-5d3faa78d88e None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.611070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee4ef-46b9-40f0-885a-5d3faa78d88e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.611347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee4ef-46b9-40f0-885a-5d3faa78d88e None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/763cd7c148d24a679cc2a51a4edfcfa4/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.628542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee4ef-46b9-40f0-885a-5d3faa78d88e None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=763cd7c148d24a679cc2a51a4edfcfa4, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.629920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee4ef-46b9-40f0-885a-5d3faa78d88e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.646723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 307/625] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:46 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/763cd7c148d24a679cc2a51a4edfcfa4/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:46.649744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.650295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.650778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.693363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:46.696741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:46.719616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb6226-c8a7-4f3b-84c8-5321a0fde01a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.804085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.807085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.807885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.809542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.833937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.839125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.854353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 308/626] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-76167136-c25c-4666-9e70-e355b7e23747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:46.866961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.867973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:46.868896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:46.868896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.868896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:46.872769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 319/627] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.875723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.892753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.911998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53ccee-f060-4bac-9cf4-f41e6c977f5a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.912655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53ccee-f060-4bac-9cf4-f41e6c977f5a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.913971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53ccee-f060-4bac-9cf4-f41e6c977f5a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.916909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 320/628] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:46.924760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.925041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.925296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.950402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:46.951591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:47.001755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53010f92-b458-4aa1-913c-42a26adba255 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.040684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a184-c0df-4362-9480-60298d917552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.041751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a184-c0df-4362-9480-60298d917552 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.042277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a184-c0df-4362-9480-60298d917552 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.042747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a184-c0df-4362-9480-60298d917552 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.043597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a184-c0df-4362-9480-60298d917552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:47.044097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a184-c0df-4362-9480-60298d917552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.045824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a184-c0df-4362-9480-60298d917552 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.049550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.060956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 309/629] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:47.072153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a184-c0df-4362-9480-60298d917552 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.083361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 321/630] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:47.174455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.205423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.260410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a184-c0df-4362-9480-60298d917552 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.323495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.325403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.326613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.327241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.353613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.355301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:47.374564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:47.375773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:47.376983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:47.384480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2e02-379d-45b5-a46f-3c594b87a5ff None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.385797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 310/631] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:47.393921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.456418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497382b-d0d8-4f79-abbe-fc87bbd13ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.457409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497382b-d0d8-4f79-abbe-fc87bbd13ec4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.457836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497382b-d0d8-4f79-abbe-fc87bbd13ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.458252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497382b-d0d8-4f79-abbe-fc87bbd13ec4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.471591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497382b-d0d8-4f79-abbe-fc87bbd13ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5497382b-d0d8-4f79-abbe-fc87bbd13ec4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:47.476617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:47.477573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:47.478968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 322/632] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:47.479671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b51acd-33d6-48f1-985a-7fc31aafa7c6 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.479671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b51acd-33d6-48f1-985a-7fc31aafa7c6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.479801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b51acd-33d6-48f1-985a-7fc31aafa7c6 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.481569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 323/633] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:47.486327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b51acd-33d6-48f1-985a-7fc31aafa7c6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.528628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.541807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb401d-28d8-4a9c-be87-d68387f8aa56 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.577963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.584819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.585446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.585722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.585996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.586910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:47.587572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.589337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9d0a-0170-4bd9-a719-56adab8ff784 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.597999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b51acd-33d6-48f1-985a-7fc31aafa7c6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.614671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 311/634] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:47.614671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.614671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.614671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.633327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:47.634629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:47.639785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.640394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.640668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.640969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.641638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:47.641935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.643295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.657486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 324/635] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:47.657486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.720076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 312/636] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:47.720958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.783379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.788927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b010e16-ded7-4f08-86a8-7db5f662eab3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.827011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.828116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.828546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.829116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.840818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:47.846838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:47.847991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:47.849026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:47.851867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 325/637] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:47.852860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b9e23-46ae-465e-947c-a7386a644c6e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.853163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.878672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.899484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.900101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.900497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.900794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.972618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf582f0-1a01-4bee-a48e-5ed784b7379a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.983160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.985080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.016843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.019216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.019216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.019216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.032455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.032804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:48.048287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.049338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:48.050236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:48.050236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.050236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:48.050236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 326/638] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.050236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.072767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.104687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 313/639] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:48.105453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.130731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.176441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533710ed-9807-4be0-b40e-d3246a14e37d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.211979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.212588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.212906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.213182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.213847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.214153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.215522 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.223401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 327/640] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.224190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.224585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa519e3d-e9a5-41bc-9cee-7fb0441e2a01 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.269117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.269864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.270046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.270303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.282115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:48.287244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.288774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:48.289668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 314/641] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.290936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.311032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.336886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2916af-fcc0-48d9-ac9b-b32e1bdd49ba None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.377752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.378290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.378564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.378832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.379473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.379772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.381181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.389945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.400228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 328/642] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.400228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.418402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6830-a9f0-4b83-852d-bf141596c7f3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.456215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.457208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.457779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.458259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.470573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.472271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:48.488595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.489878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:48.491595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:48.491595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.491595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:48.493353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 315/643] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.494364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.505307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe164d4-7e76-4b62-a8f2-877a1c37bdd3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.541628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.542256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.542554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.542809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.544793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.553739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.555192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:48.570490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.571502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:48.572586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:48.572586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.572586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:48.572586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 329/644] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.572586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.607355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520a35-4b55-48ce-a6d6-58d788fc9249 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.642059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.648987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.649729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.650008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.650286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.651013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.651319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.652776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.668381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 316/645] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.668381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.684173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dda85-b2c9-4345-8010-2294f03d2e71 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.719460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.720092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.720370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.720673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] PATH_INFO: `/v3/users/glance` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.728709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.730179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:48.742999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.745343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 330/646] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.747274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.793349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1b30-46cf-4c2a-9262-360d65e13127 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.801737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.833515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.834146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.834428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.835338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.836416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.836744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.838565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.851704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 317/647] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.852549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.864764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480bddd-b2c2-4caf-9cfd-6afa66d1d8de None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.902236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.902885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.903162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.903438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.904080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.904380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.905792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.913115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.919393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 331/648] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.920228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.972301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df351bab-8b90-4228-916b-0f4880fce374 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.008791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.009425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.009702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.009974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.021693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.024201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.037627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2392d2-c56a-44d3-b9dd-f5a96d531a40 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:49.040606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:49.041583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:49.042489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:49.042489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:49.042489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:49.042489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 318/649] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:49.043102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.050269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.079486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.080096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.080375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.080644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.081402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.081706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.083157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.101019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 332/650] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.101880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.155678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a81a-3215-454b-9d91-ca7d01a606f4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.162686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.190967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.191603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.191884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.192156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.199549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.201019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.208671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7965ef-c410-4439-bf04-920daecce684 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:49.212175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:49.213128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:49.214007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:49.214438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 319/651] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:49.215263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.243200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.243824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.244095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.244457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.251389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.252858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-785c8bc4-79ea-430e-88f3-aadf49b7831d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:49.264889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:49.265900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:49.266942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 333/652] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:49.267550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6906049-890a-4cfc-977d-3ededc2400ba None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.267550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6906049-890a-4cfc-977d-3ededc2400ba None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.267684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6906049-890a-4cfc-977d-3ededc2400ba None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.271695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 334/653] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:49.271695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6906049-890a-4cfc-977d-3ededc2400ba None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.295574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.327934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69d7a-a513-451e-a781-8595ca8a75cf None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.364226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.364860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.365141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.365418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.366598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.367469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.368898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.375520 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6906049-890a-4cfc-977d-3ededc2400ba None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.380118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 320/654] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.380969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.410231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.415275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e52ff7-3bda-4612-8432-bf5f265c3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.415881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e52ff7-3bda-4612-8432-bf5f265c3e10 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.416158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e52ff7-3bda-4612-8432-bf5f265c3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.416425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e52ff7-3bda-4612-8432-bf5f265c3e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.486285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967eff5-7d02-4a88-aef6-3a7e3977ef7f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.489857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e52ff7-3bda-4612-8432-bf5f265c3e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.491946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e52ff7-3bda-4612-8432-bf5f265c3e10 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.515617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.521367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.521974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.522248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.522517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.523204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.523500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.524959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.542790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 321/655] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.542790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.592678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 335/656] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:49.594016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.594307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.594581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.612711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:49.614017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:49.627704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.642469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dae14-e982-4a6c-9ab6-97d87ae1ca87 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.676997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.677532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.677810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.678084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.678839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.679143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.680566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.682819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 336/657] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:49.683839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.698368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 322/658] 10.222.0.45 () {56 vars in 1139 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.699040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.744674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.794470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049311-9cc8-4789-87d2-fd7f8f722dec None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.808253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289cb3c-ed77-493b-97da-cbb07948fd5a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.830235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.830886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.831124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.831395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.839035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.840488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.847599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.848455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.848943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.849398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.850352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=464a6f0e27d642efb036de9164eeefc9) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.851408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:49.852629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:49.853770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 337/659] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:49.854713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.855932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.863690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 323/660] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/role_assignments?user.id=464a6f0e27d642efb036de9164eeefc9&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.864762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.884192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.992509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0be7-bbf7-47ee-a54a-c4f0a449d696 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.002998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044751f-5629-4bef-8039-98727a7eed2d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.019886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.031820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.032757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.033113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.033845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.045464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.046202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.046543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.046873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.058759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.060471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:50.078499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:50.079644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:50.080557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:50.080557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:50.080557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:50.080557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 338/661] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:50.080557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.114357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.116167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.129090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.208444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a834-cca4-4494-8792-6adf92917ba2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.231482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 324/662] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:50.233723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.245787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.246328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.246605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.246876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.247608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.247910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.249390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.267393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 339/663] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:50.272641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.299104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.345974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910a45-db88-492d-9116-96e892bbd40b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.356294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.385496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.386126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.386514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.386889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.388395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0ec9-f908-4da0-a7ad-f708fbfa34ee None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.398442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:50.403159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:50.404326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:50.405424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 325/664] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:50.406151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.431674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.432280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.432665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.432976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.433730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.434029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.435394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.448899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 340/665] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:50.450158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.517727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640e9b5-0aaf-4bd2-a219-44b758a67200 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.540592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.554968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.555955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.556244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.556517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.559060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a13db-a2a0-460e-af18-8167b9d461a6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.566925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.568373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:50.583682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:50.585510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:50.586464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:50.586464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:50.586464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:50.586464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 326/666] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:50.586688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.600470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.601448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.601867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.602457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.613210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.672902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.674371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.701123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75e2c-af3f-4a14-bae4-9e987c90edc4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.737507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.738133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.738413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.738686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.739404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.739708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.741188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.749557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 327/667] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:50.750233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.770037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.788176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 341/668] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:50.788759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.850469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.872630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e66c-3317-4846-a4f7-bb1f70b38fc7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.903644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dbc93-4ba8-4749-adda-c8ee25973831 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.908299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.908967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.909246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.909517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.916971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.918711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:50.930308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:50.931201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:50.932088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 328/669] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:50.932597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.947107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.947715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.947999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.948273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.948948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.949248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.950619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.966250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 342/670] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:50.966250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.011837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.048482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636652-2f91-4b2f-b9b1-2871bf67e94c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.070030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263537b4-65dd-4b56-90a6-b1810499e317 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.086611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.087543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.087832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.088107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.098788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.100768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.106374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.107009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.107403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.107678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.110962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:51.120011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:51.121048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:51.121945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:51.121945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:51.121945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:51.121945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 329/671] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:51.122255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.127988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.129993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:51.146161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:51.147727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:51.148757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:51.148757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:51.148757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:51.152461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 343/672] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:51.153344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.237106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612f46-898a-4cfa-9950-92fe454fbe68 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.257408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.264393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599746-4822-4519-b891-1d782152d3dc None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.280648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.281287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.281566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.281841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.282539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.282839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.284276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.302034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 330/673] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.302034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.308511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.309202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.309489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.309764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.318174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.320095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:51.333029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:51.333998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:51.335431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 344/674] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:51.335914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.370166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.418589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906cb5-9fc6-49d0-97d6-c920e71eb2ae None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.458184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f88abe-6551-4db2-9b29-7a056a80f715 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.461479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.462290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.462693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.463060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.463943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.464304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.465747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.483232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 331/675] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.483232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.497269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.497948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.498229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.498501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.499137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.499432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.500840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.517493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 345/676] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.517493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.535030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.601454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104d192-6b26-470e-8241-7f05867f5a7d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.617134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.621773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dece59-65a0-4957-806d-5b985207b1a5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.639924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.640705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.641011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.641587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.642328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=cc2459051d2b42ad8a9c4d51568d2c09) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.642635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.644502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.651218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 332/677] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/role_assignments?user.id=cc2459051d2b42ad8a9c4d51568d2c09&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.652340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.669273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.670020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.670371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.670713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.671616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.671993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.673620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.688433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 346/678] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.689671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.789780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442c0b-0947-4558-b0d7-531ff66d9e46 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.803795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.832701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.833763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.834380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.835586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.839911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857232a-f0a4-4c54-baf5-898244e782f3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.844988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.846764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:51.861812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:51.862856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 333/679] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:51.863795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.890619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.891369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.891658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.891939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.900915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.902881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:51.915887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:51.917305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:51.918285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:51.918717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.922579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 347/680] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:51.923502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.992568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ce7f-5afa-4c91-944e-004141ab6db5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.032260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.033071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.033443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.033809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.034633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=4b448cdeede24aa9bb0fc1a9f210b53f) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:52.035033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.036629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.042896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df107429-231b-4f7b-a22e-56573bc250c8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.043745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 334/681] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/role_assignments?user.id=4b448cdeede24aa9bb0fc1a9f210b53f&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:52.048771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.110351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.111283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.111705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.112298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.113333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:52.113827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.115483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.125984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.160490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 348/682] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:52.161871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca250ca-fabf-4cbc-be75-612251dcde13 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.163757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.166165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.201782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.202568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.202909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.203249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.204059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:52.204428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.206272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070fda7-485e-4968-a37d-411c147bd071 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.222034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 335/683] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:52.223464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da38a-439e-4fc5-8a35-3d47977aeedc None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.223818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da38a-439e-4fc5-8a35-3d47977aeedc None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.224163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da38a-439e-4fc5-8a35-3d47977aeedc None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.225912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 336/684] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:52.227954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da38a-439e-4fc5-8a35-3d47977aeedc None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.294833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a5b6-33f6-406a-a4c0-df75d086a004 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.334213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.335162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.335446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.336026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.356669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da38a-439e-4fc5-8a35-3d47977aeedc None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.410691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.411829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.412338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.413401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.415436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.417258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=511d91463bbf43ef878a3111e4c11b73) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:52.417648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.420307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c15040-9907-4574-9586-a8bd9219d5c6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.426991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 337/685] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/role_assignments?user.id=511d91463bbf43ef878a3111e4c11b73&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:52.428045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.428395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.428672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.428910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.430748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.465961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:52.467419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:52.513984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.603374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 349/686] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:33:52.609648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.628102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 338/687] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:52.723061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.730587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5279b-d668-4634-ba81-0a6cee887d67 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.780556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.781251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.781531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.781804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.792927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.794633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:52.813191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:52.814232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:52.815383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:52.815383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:52.815383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:52.815383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 350/688] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:52.822460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.929391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab17100-eb00-4a97-83b3-d0f38c09254f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.960153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.968794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.969416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.969713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.969996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.970785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:52.971086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:52.972461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:52.985922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 339/689] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:52.993330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.031030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.159883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e83925-f524-4359-9c08-c642d16af232 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.168192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed87e43-cd95-4802-a95d-19b1c452e2b8 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.207457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.208469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.209000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.209508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.217247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.219164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:53.233190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.234150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:53.235063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:53.237776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 340/690] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:53.240009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.240982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.241306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.241398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.247368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.268145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:53.277991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.279198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:53.280321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:53.289074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 351/691] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:53.293673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.307382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.400861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.446463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85392b5f-b8da-4bd9-85ca-c604db60da7d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.449700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b944974-cf71-4cde-8df8-9ec720260471 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.501658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.501658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.501658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.501658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.502045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.502045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.502045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.510253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 341/692] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:53.516207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.533441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.534065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.534347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.534624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.535296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.535601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.537102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.565809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 352/693] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:53.572008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.627456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03546b20-e3ac-47cd-bd89-8abfba563963 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.665815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.666423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.666755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.667031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.667750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=763cd7c148d24a679cc2a51a4edfcfa4) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.668051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.669979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.673406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.677421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 342/694] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/role_assignments?user.id=763cd7c148d24a679cc2a51a4edfcfa4&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:53.717526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.762440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951489cf-6605-4f50-8003-63bb91e5bab4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.826477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.827134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.827411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.827682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.845270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.846734 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:53.863436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.865871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:53.868041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:53.868041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.868041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:53.868041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 353/695] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.874333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.002274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810c4b0-9bf8-4d47-b55d-58390fba9236 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.049767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.050643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.050996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.051275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.051988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.052357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.054249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.067885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 343/696] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.074121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.186873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198c6f-7742-4759-8146-ff1d9a7742ea None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.210208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.225242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.225878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.226155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.226425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.234610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.236069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-ec27f822-e454-461c-a366-0fb089e153f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:54.248139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:54.249178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:54.251448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 354/697] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:54.255235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.352073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.412029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34b5e9-adb3-495b-9700-142e6aa5cd0b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.417773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184411c6-0bf2-4f3f-876d-95df52091878 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.418058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184411c6-0bf2-4f3f-876d-95df52091878 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.418334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184411c6-0bf2-4f3f-876d-95df52091878 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.419928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 355/698] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:54.425104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10946-e679-48be-88dc-45dd947072bb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.425386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10946-e679-48be-88dc-45dd947072bb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.425652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10946-e679-48be-88dc-45dd947072bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.450370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-69f10946-e679-48be-88dc-45dd947072bb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:54.451725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-69f10946-e679-48be-88dc-45dd947072bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:54.468128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.468896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.469185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.469460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.470200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.470507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.472078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.506321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 344/699] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.513033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.559447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 356/700] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:54.611604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00ab2-6838-492f-9559-2f4638e4fdfc None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.611886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00ab2-6838-492f-9559-2f4638e4fdfc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.612069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00ab2-6838-492f-9559-2f4638e4fdfc None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.613744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 357/701] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:54.625499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.625926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.626300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.648200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167c770-262b-472a-9f94-5bdd66b1c636 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.657791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:54.659008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:54.673091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.703929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.704554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.705359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.705638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.776668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 358/702] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:54.814743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.816204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.885105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.951501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 345/703] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:54.956936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.957974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.002235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.057222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb5db3-bbcf-42d5-9fea-a5199cac77e0 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.127031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.127794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.128048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.128321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.140557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.142186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.144587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff321419-17f5-463d-b392-5a47cb1c7042 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:55.159159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.160172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:55.161104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:55.161104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:55.161104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:55.161104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 359/704] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.161883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.189058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.189907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.190514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.190846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.202559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.204013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:55.221435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.223590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:55.224697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:55.224697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:55.224697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:55.224697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 346/705] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:55.224697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.265547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.278897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cbdb4-e508-4bc2-a2c7-101b464fde79 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.310691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.323888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.324919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.325391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.325849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] PATH_INFO: `/v3/services/network` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.326786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.328604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.341952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:55.343908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:55.352247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25397520-e624-435e-b16e-3990fc6b80ba None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.352564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 360/706] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.353826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.384470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.385105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.385381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.385649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.386488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.386600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.387932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.405501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 347/707] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.406342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.470096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135ca98-ae91-4f13-904e-6cc742b3baaa None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.508154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.508810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.509103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.509382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.510031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.510334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.511729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.521211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff6d8-a07c-459e-8e49-7d183445e4a2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.523165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 361/708] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.523965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.544180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.560968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.567980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.568666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.569665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.569665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.570235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] RBAC: Adding query filter params (name=network) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.570563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.572054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b254c-c904-4ca4-8db2-b83752c21e38 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.577214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 348/709] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.582801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad73ae-0848-42d4-b0d7-b138728476b3 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.583086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad73ae-0848-42d4-b0d7-b138728476b3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.583360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad73ae-0848-42d4-b0d7-b138728476b3 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.588752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 349/710] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:55.588752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad73ae-0848-42d4-b0d7-b138728476b3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.636811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965892c-3c44-43b9-a1ff-03032548b396 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.674690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.675204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.675477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.675745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.676384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.677845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.698980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 362/711] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:55 2022] POST /identity/v3/users => generated 254 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:55.698980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.719225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad73ae-0848-42d4-b0d7-b138728476b3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.767461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.768239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.768594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.768971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.779852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.781821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.783486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c5088e57-2c26-414f-a0c6-28ebfb9502b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:55.801256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.802371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.803990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:55.806811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 350/712] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.808395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.808867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.809333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.834760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:55.836149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:55.837394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f260b51-8911-4273-958b-0af47b3e7166 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.885095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.885874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.886246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.886615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.887357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] RBAC: Adding query filter params (type=network) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.887779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.889316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.902652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 363/713] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.902652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.915801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.943336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 351/714] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:56.025700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfd8ac-e530-4740-8646-cf5206b3a52a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.065396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.066046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.066327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.066602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.067325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.067631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.070069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.073292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.086557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 364/715] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.092304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.229029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730fb1-4d48-4de7-830b-cd43abb5b1de None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.268553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.285585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.286109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.286390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.286660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.288017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=464a6f0e27d642efb036de9164eeefc9) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.288499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.292751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.296644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 352/716] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/role_assignments?user.id=464a6f0e27d642efb036de9164eeefc9&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:56.421926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2af263-5782-4575-9e53-9e29a448f07a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.461401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.462284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.462705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.463144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.463910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.465435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-90105479-6675-4f5a-a3be-4797cde4f5e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:56.474715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:56.476503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:56.477610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:56.483655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 365/717] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:56.486716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.547618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.619535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9e9f2-0bea-4c64-a0d9-3aa359ccc268 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.658123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.658798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.659083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.659355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.660289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.660289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.661676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae045c92-c9c7-48e4-93a7-58e381e3c669 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.662312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822dab9-24b4-4ef3-bd7f-3e6f4a7fcf77 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.663326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822dab9-24b4-4ef3-bd7f-3e6f4a7fcf77 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.663813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822dab9-24b4-4ef3-bd7f-3e6f4a7fcf77 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.666912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 366/718] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:56.668014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 353/719] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.673447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822dab9-24b4-4ef3-bd7f-3e6f4a7fcf77 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.682219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.682528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.682777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.717281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:56.721747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:56.813569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.868373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 354/720] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:56.898722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822dab9-24b4-4ef3-bd7f-3e6f4a7fcf77 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.941564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.942179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.942459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.942732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.943368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.944253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.946184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.951550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 367/721] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:57.285354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:57.332788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:57.399968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891c61e-1ed3-409e-9864-49bda3b14efe None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:57.448490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:57.449155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:57.449434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:57.449709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:57.466951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:57.471753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:57.472684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:57.473561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 355/722] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:57.481829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:57.610580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc04197-9a82-4544-9b69-33704fe0dfd7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:57.635391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:57.646801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:57.647489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:57.647677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:57.647959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:57.648835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:57.649143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:57.650581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:57.665142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 368/723] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:57.670826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:57.790535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9888b0-4572-41de-b0f8-e5cf0062378d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:57.792412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:57.828342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:57.829109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:57.829393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:57.830100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:57.840941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:57.842404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:57.858618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:57.860890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:57.861805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:57.861805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:57.861805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:57.861805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 356/724] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:57.869911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:58.014755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357059a-9b16-48c8-ac77-c13397f83230 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:58.051454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:58.052064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.052344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.052619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.054069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:58.054379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:58.055824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:58.069127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 369/725] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:58.074668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:58.255420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d44f5-75f1-44d5-9922-608d2b1f5e60 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:58.306807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:58.307454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.307724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.307997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.321813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:58.323265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:58.335121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:58.336095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:58.337096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 357/726] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:58.345847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:58.432457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:58.517240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8d57-f793-4f90-a7f5-aa17c815ddce None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:58.571261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:58.571806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.572080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.572349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.573143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:58.573456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:58.574975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c6948-181f-4061-9c70-b81ce8e6b083 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:58.600384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 370/727] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:58.607042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:58.633225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:58.642948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d9445-2ec5-42ff-a4e0-39556fec87a5 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.643242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d9445-2ec5-42ff-a4e0-39556fec87a5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.643494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d9445-2ec5-42ff-a4e0-39556fec87a5 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.645375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 371/728] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:58.653219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341199a-9fb2-497c-a606-a45d875b1500 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.653778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341199a-9fb2-497c-a606-a45d875b1500 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.654249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341199a-9fb2-497c-a606-a45d875b1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.675729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6341199a-9fb2-497c-a606-a45d875b1500 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:58.677270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6341199a-9fb2-497c-a606-a45d875b1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:58.750768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a50b-973e-492b-8b80-5891a153899c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:58.787974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:58.788862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.789382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.789805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.790929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 372/729] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:58.792424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d380-1730-4e9d-9fe9-73ef983bad38 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.792813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d380-1730-4e9d-9fe9-73ef983bad38 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.793227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d380-1730-4e9d-9fe9-73ef983bad38 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.796237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 373/730] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:58.802202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.802563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.803454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.825808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:58.827318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:58.859909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:58.911012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 374/731] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:58.948127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:58.949602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:58.973912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.086011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 358/732] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:59.091130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.233062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad9786-cb0d-4bb2-8d9c-994ffdd95529 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.286491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.304414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.305094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.305373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.305653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.324054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.325557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:59.341668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:59.342614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:59.343526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:59.343526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:59.343526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:33:59.343526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 375/733] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:59.344011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.362692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.413450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a074af9-9bc1-4cf6-b57b-43d7578f3452 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.428895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.453282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e052d-e81a-454c-b4e0-04a4f480b571 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.456083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12a74d-46ed-4d28-b42b-1e5d93cd208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.456754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12a74d-46ed-4d28-b42b-1e5d93cd208d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.457039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12a74d-46ed-4d28-b42b-1e5d93cd208d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.457315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12a74d-46ed-4d28-b42b-1e5d93cd208d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.469847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12a74d-46ed-4d28-b42b-1e5d93cd208d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-dc12a74d-46ed-4d28-b42b-1e5d93cd208d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:59.474723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:59.481847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 359/734] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:59.482756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346aa1cc-4580-4451-a16b-c9eeb0665a13 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.483524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346aa1cc-4580-4451-a16b-c9eeb0665a13 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.483524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346aa1cc-4580-4451-a16b-c9eeb0665a13 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.483524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 360/735] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:59.483524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346aa1cc-4580-4451-a16b-c9eeb0665a13 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.501403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82329c53-5568-4923-9288-432f3945b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.502046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329c53-5568-4923-9288-432f3945b410 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.502326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329c53-5568-4923-9288-432f3945b410 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.502601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329c53-5568-4923-9288-432f3945b410 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.503247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82329c53-5568-4923-9288-432f3945b410 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.504633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82329c53-5568-4923-9288-432f3945b410 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.527291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 376/736] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:33:59 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:59.529078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82329c53-5568-4923-9288-432f3945b410 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.621032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346aa1cc-4580-4451-a16b-c9eeb0665a13 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.659038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.660660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.661324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.661634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.661886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.662605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.662918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.664574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c645-b360-4f49-ac1e-f057228364b3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.688771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82329c53-5568-4923-9288-432f3945b410 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.732149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.732800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.733090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.733361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.734041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.734359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.735997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf5f5c-7703-464e-946a-db4d3ed506bd None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.746915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 377/737] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:59.750943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.750943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.750943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.770280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:59.772072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:59.798897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 361/738] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:59.804156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4f3a3-109b-4478-b555-23e8a09ad814 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.804156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4f3a3-109b-4478-b555-23e8a09ad814 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.804156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4f3a3-109b-4478-b555-23e8a09ad814 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.804156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 362/739] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:59.804156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4f3a3-109b-4478-b555-23e8a09ad814 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.835380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.855173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 378/740] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:59 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:59.856297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.929759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4f3a3-109b-4478-b555-23e8a09ad814 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.935833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.973017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b309e0-c3d2-4de8-ac18-6a32330f63ff None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.977758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.978623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.979053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.979474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.993376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.995653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.012359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.013275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.013660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.014131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-9e36cfc3-91b5-4387-bb17-fb08c85ea3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:00.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.015548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:00.016458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:00.016458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:00.016458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:00.018115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 363/741] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.019217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.019501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.019770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.027542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.029043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:00.041682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.042659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:00.043554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:00.045022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:00.046441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:00.047771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 379/742] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.048628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.133368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 364/743] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:00 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:34:00.134575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.151541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.165492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20cbbc-d904-4fcc-b5b4-b911f5092d0a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.205174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.211856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.212774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.213322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.213840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.214761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.215260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.216948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.230564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 380/744] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.231979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.255531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37162cd-e3bc-4bad-a567-d428af7817b6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.304658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.305652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.306169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.306651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.307563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.308068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.309915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.324192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 365/745] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.325460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.377380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b782eb-f2a5-4290-9fe0-3074bacf91ae None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.412544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.425226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.425863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.426148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.426423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.440154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:00.445825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.446754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:00.452457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 381/746] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.453254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d58ec-0da4-419b-902e-b9e9c1444dcd None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.453667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.493701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.496681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.496681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.496681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.503955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.505435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.517221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:00.517525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.518460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:00.519406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 366/747] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.520003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.584819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb2a33-6445-4bbb-bbbe-990ec033311b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.620125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.621154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.621655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.622114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.622983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=763cd7c148d24a679cc2a51a4edfcfa4) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.623440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.625076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.627557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e235b-065f-40e9-b623-5b03d670000b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.644753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 382/748] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/role_assignments?user.id=763cd7c148d24a679cc2a51a4edfcfa4&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.644753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.670954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.676853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.677482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.678515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.678787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.679640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.681823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.704947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 367/749] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:00 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:00.705932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.837092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47d45-abbd-4e79-82e3-1097e56ade5a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.860110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.906864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.907494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d63c9-bc0a-4a44-b496-e91888e67aa1 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.908101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.908638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.909480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.911477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.912091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.913933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.925817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 383/750] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.932802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.965125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.965503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.965775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.966102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.966841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.967191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.968967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.996744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 368/751] 10.222.0.45 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.000379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.067948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.079485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a0aa-ad5e-4981-8520-bf995ed0bb2d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.125871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3cf89-f360-4f0f-8376-02a65096738a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.178315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.179342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.181147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.181618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.201160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.202100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.202553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.203035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.205933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.207699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:01.227148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:01.228167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:01.229099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:01.229099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:01.229099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:01.232860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 384/752] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:01.235951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.287040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.304668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.306144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.375690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.438127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59053849-3467-4f60-99bf-9cf3c780425f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.471556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 369/753] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:01.477688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.562108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.562732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.563015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.563288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.563942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:01.564246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.565676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.591796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da25c1-5f6a-437b-8e86-5b4336a97585 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.595182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 385/754] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.607929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.657151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.659206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.659710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.660381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.679802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.684577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:01.712764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:01.713777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:01.714671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:01.714671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:01.714671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:01.716786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 370/755] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:01.726224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.729604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.789859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.832533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069d9d3-291e-4672-8ba5-bc4e4e6fb774 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.846507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b442-fe52-411c-9368-f85fa7a59bf1 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.883988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.885109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.885222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.885761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.885871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.886088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.886354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.886741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.887762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:01.888273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.889956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080dc5c-4bf5-4838-aaef-e7490f14bc48 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.893888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.895321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.904182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 371/756] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.905829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cb582-df43-4e80-b127-646ff0c36a4b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.906317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cb582-df43-4e80-b127-646ff0c36a4b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.906792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cb582-df43-4e80-b127-646ff0c36a4b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:01.907894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:01.908840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:01.909788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:01.911466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 372/758] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:01.912489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 386/758] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:01.912792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cb582-df43-4e80-b127-646ff0c36a4b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.915567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.982362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.029549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cb582-df43-4e80-b127-646ff0c36a4b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.046613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973fd61-6879-45eb-8658-439a0c3161e7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.077595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.078802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.079668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.080150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.088081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.088912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.089304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.089577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.090174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.090284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:02.090587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.092012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.092309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2f12cae5-34bc-48ca-ab26-ac4096b1023b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:02.107852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:02.109745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:02.110685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 373/759] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:02.111178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.117032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.117032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.119761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.119891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 387/760] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:02.123516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.137127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:02.138410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:02.214960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 374/761] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:02.215775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.280338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0450d9-1c54-41f9-b9c2-717a8d785dd6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.312480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.346618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.347225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.347498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.347764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.351266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:02.351578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.353039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.373374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 388/762] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:02.379354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.400481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae836973-4e5c-4705-b94c-21cf502305f3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.461767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.462400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.462681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.463011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.481860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.483235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.493063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:02.511606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:02.512591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:02.513526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:02.513526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:02.513526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:02.517196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 375/763] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:02.519880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.565804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6420186-2a24-4ba5-9944-06bb6f35d541 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.615130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.615911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.616342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.616612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.618029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=bd166217fb89462a9ceb7aade51c4188) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:02.618480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.620561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.628527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 389/764] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/role_assignments?user.id=bd166217fb89462a9ceb7aade51c4188&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:02.630265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.665356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a7f40-10bc-43b1-bb6a-a2dded392c3f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.669061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.707524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.708144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.708423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.709416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.710069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:02.710409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.711730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.725219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 376/765] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:02.732125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.838620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f819636-318f-4c33-bb16-64ede6bf9d01 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.868509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac825d7-1484-4f82-8fa5-ee545d5247e7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.891883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.913824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.914907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.915025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.915528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.915984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.916183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] PATH_INFO: `/v3/services/network` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.916493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.917048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.917411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.919304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.927299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.928572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:02.932315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:02.933306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:34:02.934248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:02.936825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 390/766] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/services/network => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:02.945700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:02.946905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:02.948190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:02.948628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 377/767] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:02.950475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.953665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:03.006606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:03.160402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4518f-b9b3-4ef0-9f02-c955e3ed4a1e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:03.236378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:03.237030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.237313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.237587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.238289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:03.238996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:03.240562 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:03.281435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 378/768] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:03.296394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:03.340408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd0a71-10cc-4fc1-8486-f8ec1e2f645c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:03.376101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:03.376703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.377184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.377293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.377886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] RBAC: Adding query filter params (name=network) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:03.378185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:03.379544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05c4b2-fdf3-43cb-8e8b-f749eab5973b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:03.388754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 391/769] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:03.388754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f015f2-b7cb-43de-97b7-821924147b39 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.388754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f015f2-b7cb-43de-97b7-821924147b39 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.388754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f015f2-b7cb-43de-97b7-821924147b39 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.388754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 392/770] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:03.388754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ebfb-1de9-4976-96e9-153081282613 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.389233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ebfb-1de9-4976-96e9-153081282613 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.389303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ebfb-1de9-4976-96e9-153081282613 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.390675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 393/771] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:03.391405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ebfb-1de9-4976-96e9-153081282613 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:03.413132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:03.432877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7989-9836-4856-9abf-3d2364abe7d5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:03.456343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:03.472923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fac045-79ef-43a4-8ed9-b8476a9810ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:03.473592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fac045-79ef-43a4-8ed9-b8476a9810ea None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.473875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fac045-79ef-43a4-8ed9-b8476a9810ea None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.474146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fac045-79ef-43a4-8ed9-b8476a9810ea None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/464a6f0e27d642efb036de9164eeefc9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.477295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fac045-79ef-43a4-8ed9-b8476a9810ea None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=464a6f0e27d642efb036de9164eeefc9, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:03.478696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fac045-79ef-43a4-8ed9-b8476a9810ea None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:03.500760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 379/772] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:03 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/464a6f0e27d642efb036de9164eeefc9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:34:03.500760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.500760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.500760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.518537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:03.519940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:03.522674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ebfb-1de9-4976-96e9-153081282613 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:03.575923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:03.576565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.576935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.577278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.577991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] RBAC: Adding query filter params (type=network) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:03.578365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:03.580798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d75cb-02b0-486a-b654-5e1df95ee3bd None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:03.592319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 394/773] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:03.594082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.594603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.594883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.620245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:03.622433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:03.624247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 380/774] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:03.625536 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:03.749916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 395/775] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:03.774428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:03.803386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d901490-ffc8-4eed-9064-b06ef791dc00 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:03.839706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:03.840701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.841199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.841713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.842640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] RBAC: Adding query filter params (interface=public, service_id=9899e396fa14451292f6a96b23df83fa, region_id=RegionOne) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:03.843165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:03.844767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:03.854144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 381/776] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:03 2022] GET /identity/v3/endpoints?service_id=9899e396fa14451292f6a96b23df83fa&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:03.860350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:03.909260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:03.949344 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:03.987747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff54f-c028-4cf6-9448-97ab3be2fddc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.026808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.027433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.027697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.027968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.028578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.030007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.040747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 396/777] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:03 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:04.117246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41267-97c3-43fe-93d8-9d1e447098ef None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.180045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.180706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.181015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.181290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.181885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.183457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:04.205045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:04.206146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:04.206980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 382/778] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Oct 4 08:34:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:04.213290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.228836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.237446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.363038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac5f61-e2fb-4544-8842-da619875c639 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.378689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.389656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836454f-44f3-450d-a38c-82678f45010a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.406479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.406479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.406479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.406479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.407113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:04.407414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.409353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.415359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 397/779] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:04.421010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.438580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.439582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.440062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.440815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.458043 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:04.463971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:04.464943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:04.465933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 383/780] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:04.474001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.547673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d59b1-6a26-4632-b7fe-f9591ff19dad None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.588916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.589799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.592144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.592572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.593002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.593868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:04.594508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.597441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.603843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 398/781] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:04.612117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.670037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769cd0-0af8-435d-93ad-1e95f1597487 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.698644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.746017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.746630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.746906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.747177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.747841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:04.749045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.750454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.772975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 384/782] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:04.781336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.824914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bd93-2a7a-41b6-92a5-40cbe6898c55 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.887298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.888307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.889033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.889534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.890832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] RBAC: Adding query filter params (interface=public, service_id=48b4be54fba541b19d4bcaeae7d72fca, region_id=RegionOne) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:04.891374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.896745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.912637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 399/783] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/endpoints?service_id=48b4be54fba541b19d4bcaeae7d72fca&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:04.923573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.975421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0528b71-2cef-415e-8603-89adc8235be6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.021170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.042394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.044250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.044527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.044821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.068219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.071035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:05.098085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:05.099113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:05.100609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:05.100609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:05.100609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:05.107286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 385/784] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:05.114859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.141955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046136-db88-4ee4-b683-46ff925c2c28 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.143986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.187666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49400-0dfd-47f0-a044-e17e304f30bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.188657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49400-0dfd-47f0-a044-e17e304f30bb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.189190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49400-0dfd-47f0-a044-e17e304f30bb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.189665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49400-0dfd-47f0-a044-e17e304f30bb None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.190679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49400-0dfd-47f0-a044-e17e304f30bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.192431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49400-0dfd-47f0-a044-e17e304f30bb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.199453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 400/785] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/services => generated 772 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:05.201113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78727-6345-4ea3-a7b0-6346dd69934c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.201650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78727-6345-4ea3-a7b0-6346dd69934c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.202133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78727-6345-4ea3-a7b0-6346dd69934c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.208011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 401/786] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:05.210418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.210984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.211461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.247278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:05.252266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:05.290437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e05ac-8b1b-4b52-a04d-770282c21de3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.372234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.374365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.377412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.377986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.378906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.379418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.381678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.400199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 402/787] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:05.409621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 386/788] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.413791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.522301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.529342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f924-85f6-42ea-9957-2a9efb0a8e01 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.574355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.575000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.575331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.575604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.589293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.591575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:05.609613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:05.610635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:05.612213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 403/789] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:05.618518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.680536 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.724242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.786662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfb8ba-f985-4eab-939d-229d0eb9eecb None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.863850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0aff4-36d9-4ca2-affb-630fb25346a0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.866681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.867552 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.869203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.869679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.870609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.871838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.873505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.894590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 387/790] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.905508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.916617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.917146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.917426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.917699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.929029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:05.934662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:05.935651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:05.937518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 404/791] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:05.941464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.961631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.094930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7c978-ede1-4a4b-935a-367c817f6cba None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.110429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.118721 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c950e56-78ef-40bd-8968-ea0ea12c33e3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.164429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.165062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.165336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.165599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.166257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.166556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.167918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16d47-b793-4cf8-8120-bb0001bf03b5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.182816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 405/792] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:06.182816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f7251-d449-4a3c-8f59-eac266872487 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.182816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f7251-d449-4a3c-8f59-eac266872487 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.183141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f7251-d449-4a3c-8f59-eac266872487 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.184485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 406/793] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:06.186432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f7251-d449-4a3c-8f59-eac266872487 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.197490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.198501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.199519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.200028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.214364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.216200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-ddefeca2-c694-4a71-b1d3-7e38a626debc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:06.235382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.236403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:06.237705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:06.237705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:06.237705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:06.237705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 388/794] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.238993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.239348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.239693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.261430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:06.262733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:06.279026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.309996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f7251-d449-4a3c-8f59-eac266872487 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.349131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 389/795] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:06.350036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.369483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.370172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.370443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.371851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.395810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.398034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:06.433353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.434374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:06.435871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:06.435871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:06.435871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:06.435871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 407/796] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.441190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.474113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.501629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be275-3b84-4408-86d6-923b3555bbf1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.540896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.541932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.542252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.542678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.543496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.543800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.545463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.559167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 390/797] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:06.565042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.670887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce569-6d54-4085-9530-2d58d7f25909 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.717113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.725779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.726430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.726664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.726939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.727593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.727897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.729921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.742364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b604a8-f57e-4b79-a269-350f00c87d74 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.751852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 408/798] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:06.755038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.785940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.786572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.786880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.787148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.790406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.795519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.797254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:06.809571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.810680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:06.811745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:06.815197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 391/799] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.816077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.870780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931fcd-f50a-449d-9b53-67958bb95ac6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.907167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e3c1a-7fb3-4135-a5aa-0971fb44aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.907801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e3c1a-7fb3-4135-a5aa-0971fb44aea0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.908079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e3c1a-7fb3-4135-a5aa-0971fb44aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.908353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e3c1a-7fb3-4135-a5aa-0971fb44aea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.919067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e3c1a-7fb3-4135-a5aa-0971fb44aea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:06.921429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288f514-d0ed-460e-869b-9233f216422c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-672e3c1a-7fb3-4135-a5aa-0971fb44aea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:06.923758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.924740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:06.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:06.930422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 409/800] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.931698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bb07-c044-4058-95c2-9b025a61a423 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.931984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bb07-c044-4058-95c2-9b025a61a423 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.932252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4bb07-c044-4058-95c2-9b025a61a423 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.934362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 410/801] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:06.935057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4bb07-c044-4058-95c2-9b025a61a423 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.966864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.967501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.967780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.968057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.976587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.978062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:06.989569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.991067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:06.992066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 392/802] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.992650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.996845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.050805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.055344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4bb07-c044-4058-95c2-9b025a61a423 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.093920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.094534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.094814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.095088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.095850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:07.096111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.097619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806706-e9f9-4f46-aff0-1a5e65a82f4d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.101485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4cbe1-f9a9-4894-a5bf-965605099657 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.117497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 411/803] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:07.118603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.118603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.118886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.141669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:07.142855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:07.150704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.151343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.151624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.151896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.152556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:07.152894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.154264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.162983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 393/804] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:07.163642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.219765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 412/805] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:07.220471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.265702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.283187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119ae65-8c45-4b07-998c-8bdf87192097 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.310007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.331710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025fd7-e4d1-4a13-ab0c-bcb499c8b035 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.333107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.334187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.335472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.335941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.336896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:07.337391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.339031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.363841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 394/806] 10.222.0.45 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:07.366232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.371597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.372002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.372372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.372792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/763cd7c148d24a679cc2a51a4edfcfa4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.375010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=763cd7c148d24a679cc2a51a4edfcfa4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.376563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.396787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 413/807] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:07 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/763cd7c148d24a679cc2a51a4edfcfa4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:07.396787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.536537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8149856-cb52-4edc-a0f0-b4ffbc76b6e1 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.579728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.580605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.580740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.581082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.581456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.586911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed029a0-3973-48b3-b8ba-3928e40b73b2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.595306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.597051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:07.623801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:07.625024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:07.625961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:07.625961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:07.625961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:07.625961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 395/808] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:07.626513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.642027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.642248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.642478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.643195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.655732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.657270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.672316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:07.683067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:07.684141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:07.685170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:07.685170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:07.685170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:07.687833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 414/809] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:07.689466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.755531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf6f6-f6d8-4df1-bdce-5e6a05e914c5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.796670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.797252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.797542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.797794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] PATH_INFO: `/v3/services/network` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.798380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.799838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.806556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f368d1b-988b-4f85-861e-8620e441e120 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:07.810964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:07.811952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:07.812994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 396/810] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:07.813788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.862482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.863103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.863437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.863702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.864372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:07.864816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.866288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff047be-5344-4bd6-b5db-86d96446e22e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.890041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 415/811] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:07.890041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab032d-0f3b-4194-896e-c800132a2d64 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.890041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab032d-0f3b-4194-896e-c800132a2d64 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.890041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab032d-0f3b-4194-896e-c800132a2d64 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.890041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 416/812] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:07.890041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab032d-0f3b-4194-896e-c800132a2d64 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:07.906058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.950219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:07.962759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85d7b-a26a-4dd5-8ac0-fa7d4bcc0a84 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.999404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.000015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.000300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.000578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.001250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:08.001556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.002930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.004858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab032d-0f3b-4194-896e-c800132a2d64 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.014931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 397/813] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:08.015771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.046021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.047137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.047368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.047647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.048433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] RBAC: Adding query filter params (name=network) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:08.048744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.050130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdd3b-c39b-409e-831b-a2b559276099 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.061360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 417/814] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:08.062314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.062604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.062878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.081150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:08.082350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:08.129917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12191a-2017-4ed0-b7dd-2d2c25b7bdc2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.173615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 418/815] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:08.174477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.181811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.182799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.183151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.183494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.188234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.195153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.197019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:08.211462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:08.212494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:08.213489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:08.216872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 398/816] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:08.217960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.238822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.320803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faaa09a-a9b1-452e-9cea-28362cf4cd7f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.345949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff497d-3e4f-4925-a609-10b8f57b3567 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.375828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.376588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.376981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.377328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.388835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.390630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.391504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.392360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.392880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.393360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.394264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] RBAC: Adding query filter params (type=network) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:08.394821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.397084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.404161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 399/817] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:08.404623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:08.405659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:08.406592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:08.408260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.410642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 419/818] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:08.411516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.483585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.503808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.520881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e44f-cabd-4719-8ac5-77cef8089edb None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.530019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e944cff-cd19-445f-9bec-d53725947f68 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.555159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.555791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.556068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.556339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.557068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.558411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.565723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.566405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.566755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.567101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.568484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:08.568988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.570486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.581117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 420/819] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:08.581946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.604879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 400/820] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:08.606473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.724766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40203e-5ccc-4226-91a6-c37df085272f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.749313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.764646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93664c70-4ab6-4852-9cb7-c86ac71338ce None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.773963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.774572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.774846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.775111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.775862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:08.776156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.778264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.792851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 421/821] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:08.793697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.813655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.814584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.815292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.815677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.816280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.820168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.822621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:08.831677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:08.832679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:08.834387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 401/822] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:08.835521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.932237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179cb37-d48a-4fec-9a28-c4eb47f93dd3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.970768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.971433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.971719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.971991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.974702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1141c19-6e61-4757-9831-002a7ca9fd6e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.024304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.025063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.025707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.026003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/bd166217fb89462a9ceb7aade51c4188/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.030327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.044174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=bd166217fb89462a9ceb7aade51c4188, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.045661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.059118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.060601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.064973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 402/823] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:08 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/bd166217fb89462a9ceb7aade51c4188/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:09.069918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.180661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.239145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 422/824] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:09.248767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.257095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dee02a-5347-4583-8099-dcb337907c7c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.305328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.305951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.306238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.306513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.307272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:09.307579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.309105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.316092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 403/825] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:09.322655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.340852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.360631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a19cc-da60-4224-a0bf-bb65df39d934 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.398986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.399552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.399840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.400119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.411089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.412650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:09.428979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:09.430181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:09.431291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:09.431291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:09.431291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:09.431291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 423/826] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:09.436641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.446712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627ea3-c738-4fdf-8fb8-2c44334ab7f4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.467134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.496294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.497457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.497888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.498339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.499287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:09.500039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.501594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.508952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 404/827] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:09.514314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.555179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25011-f633-4421-8a51-20ab028e3f4c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.592242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.593045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.593423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.593819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.594673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:09.595128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.596637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.613126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.614390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 424/828] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:09.617409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.651140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d669-ecd7-48d5-a8f4-1ad069c837a7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.694270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bcb7e-484a-4ec0-a9f5-0364ca9723e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.695344 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bcb7e-484a-4ec0-a9f5-0364ca9723e4 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.695723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bcb7e-484a-4ec0-a9f5-0364ca9723e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.696096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bcb7e-484a-4ec0-a9f5-0364ca9723e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.697062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bcb7e-484a-4ec0-a9f5-0364ca9723e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.699139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bcb7e-484a-4ec0-a9f5-0364ca9723e4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.745141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 405/829] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:09.747678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82183c7-df17-4eb4-bcaf-831c0966b166 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.759765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aac58-0454-47a7-92a7-2123351937b0 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.761940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aac58-0454-47a7-92a7-2123351937b0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.762708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aac58-0454-47a7-92a7-2123351937b0 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.764790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 406/830] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:09.770255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.770875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.772069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.797870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:09.799705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:09.800128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.800819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.801104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.801375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.811504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.813966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:09.831089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:09.832172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:09.833216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:09.836837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 425/831] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:09.845228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.847749 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.906823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.917845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 407/832] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:09.975524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224f06-dec8-4ca7-80c6-d1d528866151 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.012579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.013219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.013494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.013764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.014457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.014756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.016187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.030026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 426/833] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:10.035811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.146624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694d404-b3aa-40d8-b064-a650b5de8a04 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.184283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.184844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.185127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.185396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.186129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=464a6f0e27d642efb036de9164eeefc9) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.186432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.187864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.194457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 408/834] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/role_assignments?user.id=464a6f0e27d642efb036de9164eeefc9&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:10.202234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.319971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606e68-8624-4e24-a1a0-e45997373334 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.328964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.360319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.361002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.361284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.361560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.374016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:10.378882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:10.379862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:10.381648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 427/835] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:10.386808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.417369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.496055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185740b-f43e-4240-a474-0ce60b515115 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.532219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.532857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.533138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.533410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.534137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.534443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.535826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.546846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 409/836] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:10.553123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.660532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e511c0-2e32-4139-8c41-3e50f7cfd588 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.696732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.697373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.697654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.697952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.709217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.710679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:10.727360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:10.728360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:10.729297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:10.729297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:10.729297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:10.729297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 428/837] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:10.734665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.840397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.855923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec24a6-f4f1-48d1-b626-4ec6783b07e4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.891062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.891677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.891956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.892228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.892951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.893259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.894628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.907629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 410/838] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:10.913963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.935436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.022906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a2d5e-e2d4-478c-934a-fb9dce2c346f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.059370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.060004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.060285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.060557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.069206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.070875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:11.082605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:11.083935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:11.085120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 429/839] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:11.089971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.196372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08891a7-d78d-466b-99e5-4ccc1ab7f451 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.234952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.235619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.235908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.236183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.236949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.237256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.238699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e04bf-06b9-4df1-806e-5aaf36e0839d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.257777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 411/840] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:11.267997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.361082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.382245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b330-f950-4621-8e80-2533b0d67bb1 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.406145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1576-9083-4515-bad6-7e42d2b510b3 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.406452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1576-9083-4515-bad6-7e42d2b510b3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.406703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc1576-9083-4515-bad6-7e42d2b510b3 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.408524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 412/841] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:11.418419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.418971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.419464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.422650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.423260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.423540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.423810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.436700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.445480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:11.446986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:11.504880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.507024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.543061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 413/842] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:11.596630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.621935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 430/843] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:11.627557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.734661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac9383-9979-462d-b88e-db892f62f232 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.770293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.771523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.771818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.772076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.774989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.783303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.784774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:11.801058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:11.802147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:11.803848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:11.803848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:11.803848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:11.803848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 414/844] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:11.808150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.835299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.936106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4326-0112-4a8d-86cc-25e71cc9a78a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.949211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6be154-111c-4f36-88bb-9dfb1dd919be None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.986253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.987401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.987981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.988458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.989850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.990463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.990742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.991013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.991859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.992163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.993961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.006902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:12.012162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 431/845] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:12.012390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:12.013488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 415/846] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:12.018939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.022280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.078920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.080322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.151024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c0b1d-8389-4787-9d0c-d7e56f72fc91 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.175893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babe535-3a07-43ea-84b0-94371e6423b3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.187442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.188082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.188367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.188643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.196762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.198195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0ed82b39-dc6f-493c-8b17-7ca8fc7ed587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:12.209738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:12.210654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:12.211549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:12.213034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 416/847] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:12.215425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2280-46a6-4810-82ac-6b192b59ff93 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.215870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2280-46a6-4810-82ac-6b192b59ff93 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.216151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2280-46a6-4810-82ac-6b192b59ff93 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.221366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 417/848] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:12.221366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2280-46a6-4810-82ac-6b192b59ff93 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.223505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.224160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.224442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.224734 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.225476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:12.225782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.227230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e071f6-b35c-4c25-8528-fbd817c1ef73 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.237377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 432/849] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:12.238379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.238721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.239007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.258630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:12.259839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:12.330632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 433/850] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:12.341942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.346909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2280-46a6-4810-82ac-6b192b59ff93 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.363896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.376678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.403312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.404345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.404884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.405371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.406300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:12.406908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.408629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.425590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 418/851] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:12.433892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.462196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73138-893c-4898-a614-60d92cfc3763 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.501476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.502283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.502562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.503280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.517858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.519371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-6a7e8971-3c64-40ed-b96c-e44112f3cd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:12.534816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:12.536000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:12.537505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:12.537505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:12.537505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:12.537505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 434/852] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:12.537898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1c9b-f8c5-40a9-aab4-4c756a6c9f32 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.538182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1c9b-f8c5-40a9-aab4-4c756a6c9f32 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.538605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1c9b-f8c5-40a9-aab4-4c756a6c9f32 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.540014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 435/853] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:12.543299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1c9b-f8c5-40a9-aab4-4c756a6c9f32 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.570441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f251827-1c88-4261-a13b-a02c7b4d667e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.609329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.609941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.610220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.610484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.611219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=763cd7c148d24a679cc2a51a4edfcfa4) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:12.611522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.613013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6d063-9e09-4244-ac19-a06b23fb6a0b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.619968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 419/854] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/role_assignments?user.id=763cd7c148d24a679cc2a51a4edfcfa4&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:12.621279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.621561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.621832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.641067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:12.642500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:12.648519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.671952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1c9b-f8c5-40a9-aab4-4c756a6c9f32 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.676074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.713391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.714035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.714318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.714592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.715250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:12.715551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.717002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.733525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 420/855] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:12.733525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.736778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 436/856] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:12.748068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.862921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a9993-5107-4365-9e3d-686ce409fae1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.885823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845ded3-17c2-4b52-992f-e6b553555aef None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.910952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.912184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.912465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.912752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.913351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.915549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.927936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:12.929324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:12.930427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:12.931301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.931412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 421/857] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:12.931505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.931505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.931505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.937455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.947629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.949139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:12.962337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:12.963363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:12.964326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 437/858] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:12.969937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.973050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.986813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.086220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3b8c2-ba45-4e1a-a6a5-b96ac2c26995 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.125247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bff408-cc01-464a-922a-e47628cdeb9f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.138737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.139538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.139876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.140210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.140955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.141315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.142764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.154542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 422/859] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:13.154542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.171051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.171800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.172166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.172513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.173361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.173731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.175276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.197714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 438/860] 10.222.0.45 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:13.198587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.263960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.294773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.310101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb067aad-b9dc-4695-a5c8-c4642294198e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.313581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a241-1263-4450-9515-6e6a60020b9b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.352855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.353098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.353465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.353739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.354011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.354633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.354887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.354999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.355733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.356212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.356544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.357317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.358887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.361392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 439/861] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:13.362247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:13.376632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:13.377649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:13.378577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:13.381525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 423/862] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:13.388775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.490480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e61b-d831-4e04-bdba-f9128ee556bd None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.518792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.532707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.533366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.533646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.533917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.542618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38131646-2269-46ca-a5fa-09040485e58f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.587583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.588239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.588523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.588842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.589485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.589789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.591161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.596493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 424/863] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:13.604064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.628178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.636212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.639356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.745073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05774814-cd10-4665-b108-af1768df9e34 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.773062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 440/864] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:13.780182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.785554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.786411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.786841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.787263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.788607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.789112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.791118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.797317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 425/865] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:13.809490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.905556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac160e43-c44f-4b67-b1b0-e1488eb9f380 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.948951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.949605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.949880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.950152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.962855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.964354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:13.981164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:13.982165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:13.983064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:13.983064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:13.983064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:13.983064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 441/866] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:13.989367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.085124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.108277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5affe-f728-486a-be3e-45f2a79514c0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.144193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.144840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.145118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.145389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.146654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:14.146954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:14.148313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:14.162077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 426/867] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:14.167754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.254734 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.280394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bb961-4939-49b1-b6a1-65294becad0c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.315980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.316692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.317002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.317271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.326088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:14.327637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:14.341516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:14.342478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:14.343568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 442/868] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:14.350490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.457706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b57b2-aa6b-463d-b99b-4d06a3254c69 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.493987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.494598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.494873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.495141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.495826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:14.496127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:14.497576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029d6bc-7aac-48ba-8b96-76df9dd30b5f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:14.510118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 427/869] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:14.516054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.622560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed4c2-0ffd-460e-a662-584fe262915c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.664571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.665210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.665486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.665799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.666533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=bd166217fb89462a9ceb7aade51c4188) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:14.666836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:14.668260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822ce00-6949-46cf-b0e9-174523fd6d67 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:14.671319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.675316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 443/870] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/role_assignments?user.id=bd166217fb89462a9ceb7aade51c4188&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:15.019807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77e6b-19f2-4cb6-9b8c-775c9fbadfbf None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.020922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77e6b-19f2-4cb6-9b8c-775c9fbadfbf None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.021441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c77e6b-19f2-4cb6-9b8c-775c9fbadfbf None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.023436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 428/871] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:15.030638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.031238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.031712 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.053600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:15.055174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:15.139129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 444/872] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:15.414860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77e6b-19f2-4cb6-9b8c-775c9fbadfbf None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.418210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.530388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c77e6b-19f2-4cb6-9b8c-775c9fbadfbf None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.568879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.569919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.570400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.570872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.571730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.573535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-4b9767c2-d400-4da1-828f-854717768039 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:15.584131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:15.585235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:15.586057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:15.592877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 429/873] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:15.597906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.705518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8042-b1cb-4202-8b82-f66747680311 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.705693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8042-b1cb-4202-8b82-f66747680311 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.705910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8042-b1cb-4202-8b82-f66747680311 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.707563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 430/874] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:15.713857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.714143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.714422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.714929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b58db-75e4-42a5-9ace-4240801f2a00 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.733878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:15.735095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:15.753618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.763171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.764883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.765397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.766107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.767413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:15.768166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.770462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.782106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 445/875] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:15.784330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.806827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.820992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 431/876] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:15.901309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db1807-0dbf-4d17-bcc4-fed32be00d8c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.938037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.939031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.939526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.939999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.940854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:15.941572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.943297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82a60e-9579-4e7b-8503-2cee1562ca3a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.952862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 446/877] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:16.093660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.137959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915429c-e30a-41b0-9fa7-57b1ea81badf None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.137959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915429c-e30a-41b0-9fa7-57b1ea81badf None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.137959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915429c-e30a-41b0-9fa7-57b1ea81badf None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.138750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 447/878] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:16.145024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.145818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.146356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.166124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:16.167668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:16.244503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75ce7e-67c3-463a-b0b5-d45a6d4935c8 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.245432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.267644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 448/879] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:16.288335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9b54-e569-48e6-9e2d-d732ec21f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.289354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9b54-e569-48e6-9e2d-d732ec21f1a3 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.289816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9b54-e569-48e6-9e2d-d732ec21f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.290269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9b54-e569-48e6-9e2d-d732ec21f1a3 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.291122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa9b54-e569-48e6-9e2d-d732ec21f1a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.292674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa9b54-e569-48e6-9e2d-d732ec21f1a3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.310452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 432/880] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:16 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:16.543342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.652925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539b5de-6d0f-4123-8874-b4c9e8d8ade7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.698150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1189e-1848-4962-95cf-36427c8d72ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.699202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1189e-1848-4962-95cf-36427c8d72ad None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.699663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1189e-1848-4962-95cf-36427c8d72ad None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.700207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1189e-1848-4962-95cf-36427c8d72ad None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.701086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1189e-1848-4962-95cf-36427c8d72ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.702774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1189e-1848-4962-95cf-36427c8d72ad None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.728219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 449/881] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:16 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:17.031302 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900642-1e56-4f65-823a-41d1c0dedf31 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.031593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900642-1e56-4f65-823a-41d1c0dedf31 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.032007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900642-1e56-4f65-823a-41d1c0dedf31 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.033647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 433/882] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:17.039790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.040088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.040342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.062350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:17.063573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:17.116800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:17.158109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 450/883] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:17.433739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900642-1e56-4f65-823a-41d1c0dedf31 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:17.508571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:17.570973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900642-1e56-4f65-823a-41d1c0dedf31 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:17.611622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:17.612259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.612540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.612840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.624477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:17.629317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:17.630393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:17.631260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 434/884] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:17.637974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:17.749394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a49a6b-d6e9-4064-af44-2cc7ae74b539 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:17.790804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:17.791422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.791699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.791970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.792642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:17.793023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:17.794580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:17.803758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 451/885] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:17.809255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:17.924967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b50195-a126-4e83-be8e-4c4a7e7a9c27 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:17.943898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:17.962670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:17.963373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.963657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.963936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.975338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:17.976911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:17.993402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:17.994474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:17.995356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:17.995356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:17.995356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:17.995356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 435/886] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:18.000734 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.037340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.124090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb220-f196-4b55-ac26-a2fedcadb3f6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.167719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.168757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.169224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.169772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.170717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:18.171285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.172997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.187447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 452/887] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:18.193948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.308231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa9f6-7635-437e-9e0a-28c5a0672636 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.344583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.345245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.345520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.345786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.354103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.355811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-3b34390f-3ec5-4f78-9420-785e8d58f719 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:18.368797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:18.369820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:18.370772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 436/888] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:18.378470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.491453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.504231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21802957-356e-46ab-8417-46194ddd7cab None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.509220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7143d9-4c82-4b3c-8fe5-b8fb9492878b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.509723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7143d9-4c82-4b3c-8fe5-b8fb9492878b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.509802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7143d9-4c82-4b3c-8fe5-b8fb9492878b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.511363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 437/889] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:18.516949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c9c3f-d43d-4408-83c1-9d902fc40ce5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.517246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c9c3f-d43d-4408-83c1-9d902fc40ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.517488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c9c3f-d43d-4408-83c1-9d902fc40ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.539666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-4a1c9c3f-d43d-4408-83c1-9d902fc40ce5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:18.540899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4a1c9c3f-d43d-4408-83c1-9d902fc40ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:18.548852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.549856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.550137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.550416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.551161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:18.551469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.553681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.571729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.574357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 453/890] 10.222.0.45 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:18.581029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.650537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 438/891] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:18.705535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c912025-cc52-4da6-a956-f5f5485d90a0 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.705844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c912025-cc52-4da6-a956-f5f5485d90a0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.706080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c912025-cc52-4da6-a956-f5f5485d90a0 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.709339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 439/892] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:18.713439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.713743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.714016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.714224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f809d-c1bb-4278-8cd3-48022d0c46a0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.734209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:18.736249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:18.757300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.758313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.758605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.758914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.785375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.837486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 440/893] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:18.849251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.850929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.936146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.971902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 454/894] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:34:18.977301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.035651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.055972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.070762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348a54f-a2b5-4fde-a086-690829470f3f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.093594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55186dda-29fb-49d0-99ca-f1e54e76351d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.119321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25173-2ad4-46bf-9628-8ff81dec7f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.120061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25173-2ad4-46bf-9628-8ff81dec7f0b None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.120403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25173-2ad4-46bf-9628-8ff81dec7f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.120771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25173-2ad4-46bf-9628-8ff81dec7f0b None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.121447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25173-2ad4-46bf-9628-8ff81dec7f0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.122845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25173-2ad4-46bf-9628-8ff81dec7f0b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.134372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.135014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.135302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.135584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.139499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 441/895] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:18 2022] POST /identity/v3/services => generated 241 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:19.140788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95c47c-9ace-4e33-9139-94128cce42bd None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.141072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95c47c-9ace-4e33-9139-94128cce42bd None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.141339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95c47c-9ace-4e33-9139-94128cce42bd None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.144785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 442/896] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:19.144785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95c47c-9ace-4e33-9139-94128cce42bd None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.151475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.156151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-273c3e53-cb35-4b3e-866e-794120320492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:19.173096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:19.174831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 455/897] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.176218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.196685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:19.198014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:19.294412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 456/898] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:19.295768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.306947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95c47c-9ace-4e33-9139-94128cce42bd None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.340459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.368201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.369381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.369880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.371361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.371493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.375445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:19.396140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:19.397279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:19.398206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:19.400086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 443/899] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:19.405925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.424687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.450399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba9ee-1d41-4c2b-b287-de170d9e2ed4 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.497364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.498001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.498269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.498545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.499653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.499959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.501701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.517494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 457/900] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:19.523204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.555279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af753-0aee-4c2e-b7f1-5db0c0740bca None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.603751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.604382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.604668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.604975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.605906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.606213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.607883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.619058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 444/901] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:19.620211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.651707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.673773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8a389-d551-407d-98d1-4754c88308ea None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.711035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.722502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.723182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.724104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.724457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.732545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.734028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.742769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9a8de-532c-4e70-bbaa-cf727dbc3966 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:19.746359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:19.747423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:19.748564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 458/902] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:19.749087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.784973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.785695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.786007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.786820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.787436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.787734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.789248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.794967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 445/903] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:19.795597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.869918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcccc0-e561-40ae-91e3-28ea2129f297 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.902735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d37b-ba97-4fbd-8042-251f4eabb567 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.904415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.905124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.905411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.905686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.906272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.907677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:19.917405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:19.918540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:19.919650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:19.923266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 459/904] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:19.924106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.940445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.945381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.946071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.946405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.946726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.947467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.947770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.949278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.961073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.970371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 446/905] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:19.971136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.033950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c1054-0ea7-48e4-80d6-f4edfa5725e4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.071618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.072233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.072513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.072828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.073580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] RBAC: Adding query filter params (interface=public, service_id=502cbe2498c14cedb10a01e0ba50f77e, region_id=RegionOne) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.073891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.075267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.080388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 460/906] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/endpoints?service_id=502cbe2498c14cedb10a01e0ba50f77e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:20.081042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.087688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900ccf-6b74-49a0-942d-c329327692e3 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.127466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.128102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.129191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.129191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.129399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.130229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.131611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.137510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 447/907] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:20.138425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.181883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:20.206658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6975fc-ac5a-4235-ad90-452813eb8819 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.218350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:20.243896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.244504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.244815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.245091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.245817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] RBAC: Adding query filter params (role.id=d75c510e5a00491f837a311fd38ce1b2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=bd166217fb89462a9ceb7aade51c4188) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.246124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.247590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.253055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 461/908] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:20 2022] GET /identity/v3/role_assignments?user.id=bd166217fb89462a9ceb7aade51c4188&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d75c510e5a00491f837a311fd38ce1b2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:20.253835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.274006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e38e4a-b70d-476f-b12a-98dd5da45eb9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.313478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.314108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.314390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.314661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.315276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.316738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.324573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 448/909] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:20 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:20.397114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d508-37af-4c88-a28d-e7991458ad96 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.440342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.441022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.441304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.441642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.442953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.443264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.444762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.451493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 462/910] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:20.457623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.576879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3f70b-db48-4c18-b558-bbef86f5562a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.606562 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:20.616674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.617310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.617590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.617866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.618570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] RBAC: Adding query filter params (interface=public, service_id=79913183ad7e48d5938ebd28b5d448b7, region_id=RegionOne) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.618874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.620248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff6994-1174-4760-a5fe-723db940bdc8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.626058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 449/911] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:20 2022] GET /identity/v3/endpoints?service_id=79913183ad7e48d5938ebd28b5d448b7&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:20.631956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.635857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:20.741154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb338c-5b5e-4c60-84a4-6a201d0a0028 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.777051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297758-c1e6-412d-a3be-4d0d2b8b5ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.777661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297758-c1e6-412d-a3be-4d0d2b8b5ddd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.777936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297758-c1e6-412d-a3be-4d0d2b8b5ddd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.778206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297758-c1e6-412d-a3be-4d0d2b8b5ddd None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.778812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71297758-c1e6-412d-a3be-4d0d2b8b5ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.780174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71297758-c1e6-412d-a3be-4d0d2b8b5ddd None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.787492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 463/912] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:20 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:21.492149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68744d4-8e41-4d84-be20-fe260d7a7c58 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:21.492342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68744d4-8e41-4d84-be20-fe260d7a7c58 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:21.492611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68744d4-8e41-4d84-be20-fe260d7a7c58 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:21.494384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 450/913] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:21.500707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:21.501337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:21.501337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:21.529733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:21.531517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:21.616524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:21.623651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 464/914] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:21.902852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68744d4-8e41-4d84-be20-fe260d7a7c58 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.007534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68744d4-8e41-4d84-be20-fe260d7a7c58 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.047325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.047957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.048234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.048503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.049112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.050479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:22.060290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:22.061351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:22.062194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 451/915] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:22.069642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.190928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dfd5a-1b45-42b6-bc5c-9f5e9ce5606a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.229301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.229914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.230476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.230736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.231333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:22.231631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.233027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.238562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 465/916] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:22.248387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.320038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.367515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a699001-6752-46d5-916b-73e192c6ae40 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.404331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.404986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.405265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.405537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.406171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:22.406471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.407845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.414351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 452/917] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:22.419965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.487737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.532446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd18ab5-b8e0-4bee-8fce-e1bcfd9bfc05 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.575192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.575806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.576082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.576350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.577092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] RBAC: Adding query filter params (interface=public, service_id=7562b38c98984b2d926daddf6a39b22a, region_id=RegionOne) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:22.577396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.578836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2f77-d37a-4737-b44d-6bbcedb4ae7e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.584919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 466/918] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/endpoints?service_id=7562b38c98984b2d926daddf6a39b22a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:22.593891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.667764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3930d-3873-4d78-b2b8-aee0ca0f5155 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.668041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3930d-3873-4d78-b2b8-aee0ca0f5155 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.668437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3930d-3873-4d78-b2b8-aee0ca0f5155 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.670270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 467/919] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:22.676104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3a96f-9b58-43b6-85c9-bcceb281b25f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.676446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3a96f-9b58-43b6-85c9-bcceb281b25f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.676709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3a96f-9b58-43b6-85c9-bcceb281b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.698084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4ea3a96f-9b58-43b6-85c9-bcceb281b25f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:22.699313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4ea3a96f-9b58-43b6-85c9-bcceb281b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:22.722678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436cd78-b84a-42dc-b0ab-53ee22ca2585 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.752674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.773487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8a14-bd1a-4254-abd8-78b07a526077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.774277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8a14-bd1a-4254-abd8-78b07a526077 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.774655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8a14-bd1a-4254-abd8-78b07a526077 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.775022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8a14-bd1a-4254-abd8-78b07a526077 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.775747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8a14-bd1a-4254-abd8-78b07a526077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.778059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8a14-bd1a-4254-abd8-78b07a526077 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.788371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 453/920] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:22.802926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 468/921] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:22.808868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b65e3-9145-473f-9dc2-f4452de07448 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.808868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b65e3-9145-473f-9dc2-f4452de07448 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.808868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b65e3-9145-473f-9dc2-f4452de07448 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.812876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 454/922] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:22.815032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83135e3-ac41-43b3-99a7-c6d592d81c0d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.815314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83135e3-ac41-43b3-99a7-c6d592d81c0d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.815587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83135e3-ac41-43b3-99a7-c6d592d81c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.836634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c83135e3-ac41-43b3-99a7-c6d592d81c0d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:22.837966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c83135e3-ac41-43b3-99a7-c6d592d81c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:22.904384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.936889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 469/923] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:23.100750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b65e3-9145-473f-9dc2-f4452de07448 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.207506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512258c0-ccd3-4783-a5d0-530486aae887 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.207867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512258c0-ccd3-4783-a5d0-530486aae887 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.208295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512258c0-ccd3-4783-a5d0-530486aae887 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.210014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 470/924] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:23.215929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.215929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.215929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.233078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b65e3-9145-473f-9dc2-f4452de07448 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.235756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:23.237147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:23.281394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.282032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.282309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.282577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.295555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:23.300551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:23.309897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 455/925] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:23.311756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.340768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 471/926] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:23.340768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.372235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:23.456411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890e079-d90e-4989-88d2-5a643d73704d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.497748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.498834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.499321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.499766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.500556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.502208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:23.514731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:23.515762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:23.516618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.524117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 456/927] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:23.525727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.542302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77c06-29ab-4e27-b5e7-e8c3d8f3f382 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.565723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:23.593872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.594772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.595070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.595347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.596028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:23.596332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.597924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.609775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 472/928] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:23.615671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.652612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36f4a-c054-45f2-b575-140092b0c536 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.663960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:23.694842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.695722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.695998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.696266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.697892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:23.698194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.699607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.712541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 457/929] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:23.712541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.736070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb85f4-95c8-46ab-b3e9-b18201af296c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.778557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.779629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.779629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.780529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.795969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.798241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:23.815994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:23.823104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:23.824012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:23.824012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:23.824012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:23.824012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 473/930] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:23.824012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.841731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4be22f-f8e5-4fac-8733-f27e8d041cc4 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.856461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:23.891079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.891705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.891977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.892297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.892918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.894352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:23.905521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:23.906653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:23.907834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:23.911937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 458/931] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:23.912975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.940766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c9cbd-1354-4aa7-b62c-377bd61c9cff None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.951364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:23.981998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.982595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.982879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.983176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.983841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:23.984140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.985710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.990977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 474/932] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:23.991853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.038325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ae47-97a7-4542-b184-d57780679a82 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.090353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.090901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.091178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.091446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.092179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:24.092484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.093938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.095637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:24.110042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced69bd0-8a95-4e95-97e6-d30d4f4f2e49 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.113566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 459/933] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:24.114099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.162292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.163015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.163480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.163946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.166475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:24.166475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.166762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.173015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 475/934] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:24.174550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.238487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:24.248390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a385c3-2a97-43a3-b0ab-8439893b10c2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.293972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.294582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.294854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.295120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.295792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.297291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.323037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 460/935] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:24.334114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.341881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a32c5-79bb-4a7d-b279-b8f9303ca4ae None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.418851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.420276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.421024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.421688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.436093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.438218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:24.461836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:24.463840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:24.465805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:24.470336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 476/936] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:24.479193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.510624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:24.555248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56e7c-35f8-4262-a1ce-c8b5185a61e2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.613296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.614889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.615437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.615906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.616706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:24.616999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.618390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.626621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 461/937] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:24.631486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.636848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620aaf8-b034-48e4-a0e1-60cb86253323 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.656031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:24.691573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.692176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.692540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.692997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.693903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:24.694206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.696874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.727237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 477/938] 10.222.0.45 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:24.735521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.772440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51efb90-429f-403d-b7e6-cd6e0ed397a6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.822899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.823551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.823900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.824483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.825292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.826725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.834822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:24.868760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 462/939] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:24.876533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea0694-1efb-48f2-b2f6-080a84448e70 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.933516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.934343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.934727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.935048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.949787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.951316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:24.978561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:24.979589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:24.980873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:24.980873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:24.980873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:24.981495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 478/940] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:24.988357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.085884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.124544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def93fe0-08c2-44c3-9740-6bc077734e97 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.167117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.167745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.168020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.168340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.169024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:25.169322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.170705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08aa32-162d-42bd-9cb9-250b9184c320 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.184999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 463/941] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:25.190753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.256014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc857-747c-4149-95fb-dc9a97821e96 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.256212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc857-747c-4149-95fb-dc9a97821e96 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.256476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc857-747c-4149-95fb-dc9a97821e96 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.258307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 464/942] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:25.264371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.264650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.264955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.291841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:25.293209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:25.325075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f00a3-a183-4668-8327-c367a411c1b6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.354346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.382518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.383431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.383810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.384437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.394241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.395171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 465/943] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:25.398167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:25.416521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:25.417533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:25.418519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:25.421018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 479/944] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:25.431464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.502678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.550402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f704d-cb31-4aa2-b0d5-959b5d51301b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.596783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.597794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.598924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.599627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.600704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:25.601355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.603446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.618388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 466/945] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:25.626827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.713298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.762034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf70c6-4b12-488a-b344-6b3e5ee5768f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.815561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.816673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.818646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.819138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/bd166217fb89462a9ceb7aade51c4188/roles/d75c510e5a00491f837a311fd38ce1b2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.821686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=bd166217fb89462a9ceb7aade51c4188, role_id=d75c510e5a00491f837a311fd38ce1b2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.823353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.844149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 480/946] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:25 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/bd166217fb89462a9ceb7aade51c4188/roles/d75c510e5a00491f837a311fd38ce1b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:25.878419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836f761-0631-4518-85a9-2bda44e5bb1f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.914468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.931275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.932000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.932349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.932679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.933429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.935012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:25.946775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:25.947868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:25.948757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:25.949537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 467/947] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:25.956808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.014307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.092333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28de4a-d6b5-4c55-ae3a-08101bc9dbd1 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.146280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.147285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.147824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.148353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.149244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.149754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.151682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.158333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 481/948] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:26.165685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.300221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa819aa6-35f8-411a-afe8-2e7eca99a2cb None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.344433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.345079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.345362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.345640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.346277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.346780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.349533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a3104-d09f-4582-bf87-00e7636534a1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.355868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 468/949] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:26.361623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.473163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d8748-8caf-4873-bb29-d45b57a00c35 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.476185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.516206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af946d9f-1231-458e-ad19-15907a70b3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.516852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af946d9f-1231-458e-ad19-15907a70b3bf None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.517134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af946d9f-1231-458e-ad19-15907a70b3bf None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.517411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af946d9f-1231-458e-ad19-15907a70b3bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.518112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af946d9f-1231-458e-ad19-15907a70b3bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.519486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af946d9f-1231-458e-ad19-15907a70b3bf None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.543880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 482/950] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:26.924954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8eec-f759-402c-bf67-bf9ec268edf7 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.925462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8eec-f759-402c-bf67-bf9ec268edf7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.925851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8eec-f759-402c-bf67-bf9ec268edf7 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.927869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 469/951] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:26.934345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db408-2765-4608-bb64-d6c9b680e11b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.934834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db408-2765-4608-bb64-d6c9b680e11b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.935075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db408-2765-4608-bb64-d6c9b680e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.957471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f13db408-2765-4608-bb64-d6c9b680e11b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:26.958984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f13db408-2765-4608-bb64-d6c9b680e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:27.057607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 483/952] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:27.362753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8eec-f759-402c-bf67-bf9ec268edf7 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.430040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.503498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8eec-f759-402c-bf67-bf9ec268edf7 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.507967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf9925-0dc5-4497-9e85-b1e0ad552934 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.508538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf9925-0dc5-4497-9e85-b1e0ad552934 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.509153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf9925-0dc5-4497-9e85-b1e0ad552934 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.511045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 484/953] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:27.518598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.519200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.519683 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.541677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:27.543687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.544329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.544637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.544964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.545582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.546000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:27.547012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.549804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING keystone.server.flask.common [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 08:34:27.575248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.sql.core [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:34:27.575248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:34:27.575248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [parameters: {'id': '7dd4dd762d444c829ba812d0c947c603', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:34:27.575248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88072) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7dd4dd762d444c829ba812d0c947c603.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7dd4dd762d444c829ba812d0c947c603. Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:27.593229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 08:34:27.594838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application yield resource Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise self.value Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application session.commit() Oct 04 08:34:27.596470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:34:27.599263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:34:27.603438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:27.604583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [parameters: {'id': '7dd4dd762d444c829ba812d0c947c603', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.605840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:27.607129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7dd4dd762d444c829ba812d0c947c603. Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.608255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 470/954] 10.222.0.45 () {60 vars in 1140 bytes} [Tue Oct 4 08:34:27 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:27.616325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.692393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 485/955] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:27.799446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75e70-b484-447c-b437-6054b81183f5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.809553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.853599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.854370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.854730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.855468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.866120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.868489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:27.890175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:27.891841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:27.893004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 471/956] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:27.900583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.920595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:28.045333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138941-515e-4a82-af19-cee79d0a7f9c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:28.072921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:28.110851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:28.111482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.111762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.112043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.112746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:28.113049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:28.118422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cc945-fa28-4fce-9f4e-5179bbdc4620 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:28.142759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 486/957] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:28.199493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c446b2-0349-4bb6-8947-fdb8bfa5c905 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.199867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c446b2-0349-4bb6-8947-fdb8bfa5c905 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.200042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c446b2-0349-4bb6-8947-fdb8bfa5c905 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.201815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 487/958] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:28.209116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.209632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.210121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.240438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:28.242331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:28.254995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc400f-2abc-4f29-8be8-9db4850d5406 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:28.300637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:28.302279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.302573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.302849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.303471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:28.305263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:28.316226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:28.318187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:28.319085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:28.320821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 472/959] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:28.325315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:28.348760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 488/960] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:28.374504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:28.458770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2773def-170a-495d-b10a-5e152d1a8837 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:28.499507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:28.500489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.501113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.501590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.502478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:28.502974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:28.506484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:28.520881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 473/961] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:28.524283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:28.541531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:28.649941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:28.659051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14baf5-0529-4447-8b3c-0443056ab336 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:28.719747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:28.720792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.721273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.721766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.722659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:28.723450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:28.725183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:28.731558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 489/962] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:28.791710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:28.800089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82a446-bf61-4f37-9fa0-30e83a09e188 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:28.850544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d178-75a7-4947-9d11-9eaa883a96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:28.851611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d178-75a7-4947-9d11-9eaa883a96ef None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.852065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d178-75a7-4947-9d11-9eaa883a96ef None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.852522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d178-75a7-4947-9d11-9eaa883a96ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.871538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d178-75a7-4947-9d11-9eaa883a96ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-8ff2d178-75a7-4947-9d11-9eaa883a96ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:28.880659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:28.881859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:28.882723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 474/963] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:28.890376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:28.988700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.045602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8464ec-6bd3-419d-94c4-90d62f669761 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.075740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146008f-716b-499e-b18d-4d0c908b7a02 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.076075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146008f-716b-499e-b18d-4d0c908b7a02 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.076300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146008f-716b-499e-b18d-4d0c908b7a02 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.077990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 475/964] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:29.084446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.084753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.085040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.086226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.086848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.087130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.087408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.088086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:29.088390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.090043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.100309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 490/965] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:29.109789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.110587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:29.112084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:29.217071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 476/966] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:29.269618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171c07-9f21-474a-8e5e-6feb850527f4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.307175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.313271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.314142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.314622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.314896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.328513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.330061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:29.347868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:29.349234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:29.350441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:29.350441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:29.350441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:29.350441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 491/967] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:29.359245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.469662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.493280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e93b54-cced-4644-886f-4bfd49324934 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.509684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.531633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.532179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.532461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.532759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.533435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:29.533738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.535135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.551887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 477/968] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:29.557606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.655698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c6d0c-9885-4a5d-934c-d24484d9221f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.675618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f6a87-f21e-42b8-9408-175d969b0d2b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.702611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.703643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.704196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.704692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.705523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.707779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:29.718410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:29.719488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:29.720448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:29.722112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 492/969] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:29.726612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.728111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.728606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.729145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.734024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.739000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.740462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:29.756062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:29.757284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:29.758264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:29.760807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 478/970] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:29.763973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.796479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.797218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.867950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed260b1-ca36-4b9f-b953-02ca08f9dd96 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.913335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe29cc-f2fc-4b65-b456-31076891c1fd None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.916038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.917223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.917223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.917418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.917932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:29.918231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.919612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.925252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 493/971] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:29.931493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.968469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.969713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.970199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.976208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.977538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:29.978237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.980229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.006240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 479/972] 10.222.0.45 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:30.007633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.060121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2594e-3872-4d8c-b6cd-f9e10d93325a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.077912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.097526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.107115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.107739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.108015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.108344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.109026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:30.109371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.111063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.120759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 494/973] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:30.125326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.165250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922579b-a358-4f3c-a5ff-0656e5c2cde9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.218171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.218981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.219394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.219755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.271047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0faf-1c2c-43c3-8ab6-23ce923e49fc None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.324390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.325239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.325525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.325805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.325915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.326539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] RBAC: Adding query filter params (interface=admin, service_id=7562b38c98984b2d926daddf6a39b22a, region_id=RegionOne) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:30.326851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.328252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.328623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.341581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 495/974] 10.222.0.45 () {56 vars in 1249 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/endpoints?service_id=7562b38c98984b2d926daddf6a39b22a&interface=admin®ion_id=RegionOne => generated 193 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:30.342561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.402151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.422973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.474685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 480/975] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:30.475809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.492859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b7cfe-6093-4690-ab95-310d80abfa44 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.540705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.541838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.542842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.543275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.544389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.546409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.561968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 496/976] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:30.601722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6f8b-6b22-4b81-ac5c-58d7911a4285 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.643541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.644193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.644471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.644813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.657048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.658589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:30.676824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:30.677860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:30.678763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:30.678763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:30.678763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:30.678763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 481/977] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:30.684530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.822094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bff4-8a4d-474e-ae29-9680c8e80aa1 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.826384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.863385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.863922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.864247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.864527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.865213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:30.865521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.866913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf6390-7c7f-4f6a-979e-8016c321c1ea None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.880804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 497/978] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:30.886489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.895084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcb105-8368-49f4-b2bd-2bc2de45d004 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.895590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcb105-8368-49f4-b2bd-2bc2de45d004 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.896020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcb105-8368-49f4-b2bd-2bc2de45d004 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.897732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 498/979] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:30.905330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.905941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.906503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.910002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.930745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:30.932302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:31.007597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 499/980] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:31.013023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc1e86-4fa5-44c4-acb4-85998481026f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.056041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.057111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.057593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.058062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.066255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.068740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-b26031d1-9480-4bc4-a28d-1ab8f07b9dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:31.081641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:31.083017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:31.083962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:31.086484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 482/981] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:31.092748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.212421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.221064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2786e-fb7c-42c4-9ec2-760181c982b7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.233758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c4a9a-e412-4ea1-b17d-67916281810d None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.233977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c4a9a-e412-4ea1-b17d-67916281810d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.234192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c4a9a-e412-4ea1-b17d-67916281810d None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.235775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 483/982] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:31.246181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.246462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.246735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.261358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.262214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.262636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.263051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.263974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.264426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.266091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.267055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:31.268347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:31.279731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 500/983] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:31.286045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.348317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 484/984] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:31.348317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.355866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.420458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15d768-a4e9-42dc-b95a-83cf3fb322d2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.459843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.460548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.460917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.461252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.462068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] RBAC: Adding query filter params (role.id=d75c510e5a00491f837a311fd38ce1b2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=bd166217fb89462a9ceb7aade51c4188) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.462440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.462718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b128-7b27-4ceb-ba9e-141745bced83 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.464070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.477423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 501/985] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/role_assignments?user.id=bd166217fb89462a9ceb7aade51c4188&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d75c510e5a00491f837a311fd38ce1b2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.503156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.505161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.505814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.506265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.507153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.508884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.526708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.sql.core [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:34:31.526708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:34:31.526708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [parameters: {'user_id': '647dc8584c6c403e9b00ae3b654098b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:34:31.526708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88072) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:31.534295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:31.535414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application yield resource Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise self.value Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application session.commit() Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:34:31.536755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:34:31.537867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:31.538956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:31.540251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [parameters: {'user_id': '647dc8584c6c403e9b00ae3b654098b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.541859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 08:34:31.542945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 08:34:31.544200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 08:34:31.544200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 08:34:31.544200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:34:31.544200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:34:31.544200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:34:31.544200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:31.546447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 485/986] 10.222.0.45 () {60 vars in 1131 bytes} [Tue Oct 4 08:34:31 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:31.553274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.576762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.656649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.675719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e55bf0-7367-4c1e-91e3-1bd92e0cc745 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.721271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.723300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.724056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.724817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.736198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.737987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:31.753836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:31.755276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:31.756221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 502/987] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:31.761143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.768186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.816271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb227c7-099c-4f83-9be6-04d20c75684b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.858604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd821c-ac81-4f62-aea9-b465cfa77837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.859229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd821c-ac81-4f62-aea9-b465cfa77837 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.859509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd821c-ac81-4f62-aea9-b465cfa77837 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.859783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd821c-ac81-4f62-aea9-b465cfa77837 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.860453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd821c-ac81-4f62-aea9-b465cfa77837 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.862092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd821c-ac81-4f62-aea9-b465cfa77837 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.866114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.884944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 486/988] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:31 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:31.889950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9137b-ccc1-4ef7-a661-430dfecbd2cd None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.942525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.943055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.943332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.943606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.944329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.944696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.946299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3552c-6705-45d2-baa0-6de49014072e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.998958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 503/989] 10.222.0.45 () {56 vars in 1101 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:32.914633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470306-65ef-4f7e-b771-bb824ffe0055 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.915414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470306-65ef-4f7e-b771-bb824ffe0055 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.915414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470306-65ef-4f7e-b771-bb824ffe0055 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.916959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 487/990] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:32.923643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.924560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.924560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.944838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:32.946039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:33.020388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 504/991] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:33.294542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac470306-65ef-4f7e-b771-bb824ffe0055 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:33.404136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac470306-65ef-4f7e-b771-bb824ffe0055 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:33.432555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:33.444375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:33.445039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.445310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.445578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.446166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:33.447522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:33.456777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:33.458452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:33.459334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:33.463444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 488/992] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:33.464455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:33.529304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:33.572483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e387d4-b108-481d-9295-adf3d3e03358 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:33.610723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:33.611340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.611613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.611878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.612508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:33.612834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:33.614775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:33.619913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 505/993] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:33.625400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:33.729462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cd8b4-fe1f-4f4b-96c0-795f522b33b0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:33.765553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:33.766155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.766428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.766691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.767311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:33.767606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:33.768981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667076d3-86d3-46b1-b888-e82e88104955 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:33.774222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 489/994] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:33.779609 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:33.894892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a2623-0d40-4f01-9a1c-23962f7a7b3e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:33.922028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:33.931905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037dd3e-c0e8-4a60-977c-c54ed2e8cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:33.932566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037dd3e-c0e8-4a60-977c-c54ed2e8cae5 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.932809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037dd3e-c0e8-4a60-977c-c54ed2e8cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.933080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037dd3e-c0e8-4a60-977c-c54ed2e8cae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.933419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9979-b90a-46ba-b3e6-591d4adc47e8 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.933796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9979-b90a-46ba-b3e6-591d4adc47e8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.933871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037dd3e-c0e8-4a60-977c-c54ed2e8cae5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:33.933952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9979-b90a-46ba-b3e6-591d4adc47e8 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.935115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037dd3e-c0e8-4a60-977c-c54ed2e8cae5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:33.936479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 490/995] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:33.940746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72d563-e181-4efc-9e70-a23755f2959e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.941031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72d563-e181-4efc-9e70-a23755f2959e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.941366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72d563-e181-4efc-9e70-a23755f2959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.960771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 506/996] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:33.961408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6a72d563-e181-4efc-9e70-a23755f2959e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:33.963274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6a72d563-e181-4efc-9e70-a23755f2959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:34.023704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.054032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 491/997] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:33 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:34.249617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeeb11-bc56-4080-9180-5c11f3fb4f4f None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.249956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeeb11-bc56-4080-9180-5c11f3fb4f4f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.250126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeeb11-bc56-4080-9180-5c11f3fb4f4f None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.251484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 507/998] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:34.257594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33b25-8608-42fb-8314-923060e9527f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.257883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33b25-8608-42fb-8314-923060e9527f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.258152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33b25-8608-42fb-8314-923060e9527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.276480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-edb33b25-8608-42fb-8314-923060e9527f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:34.277698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-edb33b25-8608-42fb-8314-923060e9527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:34.324417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeeb11-bc56-4080-9180-5c11f3fb4f4f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.351270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 492/999] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:34.449309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeeb11-bc56-4080-9180-5c11f3fb4f4f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.491699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.492336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.492618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.492922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] PATH_INFO: `/v3/services/image` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.493568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.495022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:34.504145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:34.505277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:34.509906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 508/1000] 10.222.0.45 () {56 vars in 1105 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:34.511623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33b25-8608-42fb-8314-923060e9527f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.614419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33b25-8608-42fb-8314-923060e9527f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.625108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.626779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.653137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.653749 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.654027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.654298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.654923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] RBAC: Adding query filter params (name=image) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:34.655216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.656583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.664769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 493/1001] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:34.668025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.683966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.742312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eca4e-ddcb-41f0-b4ca-f264c676cd49 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.779350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.780114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.780391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.780675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.781291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.782882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.789161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66054407-106b-4a7a-a3e4-605af5acd857 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:34.793429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:34.794457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:34.795933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 509/1002] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:34.801496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.831405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.832909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.833581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.834070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.834640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] RBAC: Adding query filter params (type=image) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:34.834945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.836351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.848760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 494/1003] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:34.922464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63451b14-caf8-4abb-8fd8-ef225b650802 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.939656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.964038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101665-728a-4123-8398-89b52800216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.964775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101665-728a-4123-8398-89b52800216d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.965123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101665-728a-4123-8398-89b52800216d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.965461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101665-728a-4123-8398-89b52800216d None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.966172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b101665-728a-4123-8398-89b52800216d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:34.966542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b101665-728a-4123-8398-89b52800216d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.968019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b101665-728a-4123-8398-89b52800216d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.983193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 510/1004] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:34.989275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.037043 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.103245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887cb64-02bc-48f5-9295-7055995cc470 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.143766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.144971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.145257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.145523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.146174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:35.146461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.147810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.153033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 495/1005] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:35.160985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101665-728a-4123-8398-89b52800216d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.265032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101665-728a-4123-8398-89b52800216d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.302715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.303242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.303517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.303788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.304485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] RBAC: Adding query filter params (interface=public, service_id=3d157f78bae6412c8adebc28a75a6c8c, region_id=RegionOne) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:35.304813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.306184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c8916-079c-492b-bf1e-1ac5547759ad None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.311817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 511/1006] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/endpoints?service_id=3d157f78bae6412c8adebc28a75a6c8c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:35.318101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.425064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df7551-75fd-49c3-bd76-e7c06ec18405 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.427309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.463932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c994ae-8fae-437a-b910-59a5cbb605c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.464545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c994ae-8fae-437a-b910-59a5cbb605c1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.464866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c994ae-8fae-437a-b910-59a5cbb605c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.465142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c994ae-8fae-437a-b910-59a5cbb605c1 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.465751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c994ae-8fae-437a-b910-59a5cbb605c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.467116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c994ae-8fae-437a-b910-59a5cbb605c1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.473822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 496/1007] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:34:36.174216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad5f9-39fa-40f2-85f9-04d5763ae196 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.174727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad5f9-39fa-40f2-85f9-04d5763ae196 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.174727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad5f9-39fa-40f2-85f9-04d5763ae196 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.180787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 512/1008] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:36.183360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.183850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.183941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.218189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:36.219722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:36.294648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 497/1009] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:36.579893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad5f9-39fa-40f2-85f9-04d5763ae196 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.626290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.689104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ad5f9-39fa-40f2-85f9-04d5763ae196 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.725861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cd6ec-f8d5-411a-8015-04686e4e837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.726497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cd6ec-f8d5-411a-8015-04686e4e837a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.726771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cd6ec-f8d5-411a-8015-04686e4e837a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.727059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cd6ec-f8d5-411a-8015-04686e4e837a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.728144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cd6ec-f8d5-411a-8015-04686e4e837a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.729880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cd6ec-f8d5-411a-8015-04686e4e837a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.732822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 513/1010] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:36.737479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.836943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.844077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b1e10-b2c4-4417-b01b-287c91ea8ece None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.879413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6bac3-37d3-413a-91b6-44980a57a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.880022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6bac3-37d3-413a-91b6-44980a57a4e4 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.880293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6bac3-37d3-413a-91b6-44980a57a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.880558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6bac3-37d3-413a-91b6-44980a57a4e4 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.881320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6bac3-37d3-413a-91b6-44980a57a4e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.882740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6bac3-37d3-413a-91b6-44980a57a4e4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.916747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 498/1011] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:36 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.094662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aac3ea-ccca-4a05-9447-1baf2ea1c0ce None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.094857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aac3ea-ccca-4a05-9447-1baf2ea1c0ce None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.095134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aac3ea-ccca-4a05-9447-1baf2ea1c0ce None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.096469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 514/1012] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:37.102488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805700a-cf55-45cc-8975-347babbc2efd None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.102775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805700a-cf55-45cc-8975-347babbc2efd None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.103056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805700a-cf55-45cc-8975-347babbc2efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.123813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b805700a-cf55-45cc-8975-347babbc2efd None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.125055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b805700a-cf55-45cc-8975-347babbc2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.197349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 499/1013] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:37.471529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aac3ea-ccca-4a05-9447-1baf2ea1c0ce None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.583504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aac3ea-ccca-4a05-9447-1baf2ea1c0ce None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.596367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.625270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d90d26-e4f9-419f-a5c7-0bf0d725550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.625882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90d26-e4f9-419f-a5c7-0bf0d725550f None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.626165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90d26-e4f9-419f-a5c7-0bf0d725550f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.626438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90d26-e4f9-419f-a5c7-0bf0d725550f None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.627099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d90d26-e4f9-419f-a5c7-0bf0d725550f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.628467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d90d26-e4f9-419f-a5c7-0bf0d725550f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.645644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 515/1014] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:37.712178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f242679-8c6f-4ecb-9f12-91b8da6fd035 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.712575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f242679-8c6f-4ecb-9f12-91b8da6fd035 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.712784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f242679-8c6f-4ecb-9f12-91b8da6fd035 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.714323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 500/1015] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:37.719971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.720299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.720564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.743793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.744872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.830218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 516/1016] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:38.108046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f242679-8c6f-4ecb-9f12-91b8da6fd035 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.198275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.225256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f242679-8c6f-4ecb-9f12-91b8da6fd035 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.261615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.262246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.262519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.262787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.263422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.264833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:38.273861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:38.274925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:38.275804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:38.277472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 501/1017] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:38.281001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.379474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.387557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c2cfc-0965-4faa-8b4f-369ada7e7f51 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.426303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.426924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.427206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.427480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.428121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:38.428421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.429836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.435217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 517/1018] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:38.440702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.544677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0947d6-51f9-4039-9215-7a957feee8cc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.583986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.584598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.584903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.585177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.585822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:38.586123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.587491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33b467-a85e-4968-94fe-a9b4a3f737d9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.597889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 502/1019] 10.222.0.45 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:38.599381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.703354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e79311-911e-4e95-a6f1-b72ba1d2bfe0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.747362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aeb1f-fdbd-4a4d-8806-db1308c5d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.748107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aeb1f-fdbd-4a4d-8806-db1308c5d1d4 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.748514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aeb1f-fdbd-4a4d-8806-db1308c5d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.748855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aeb1f-fdbd-4a4d-8806-db1308c5d1d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.749931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aeb1f-fdbd-4a4d-8806-db1308c5d1d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.752236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aeb1f-fdbd-4a4d-8806-db1308c5d1d4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.780764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 518/1020] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:39.163527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8651f-11b1-4bb7-9d3f-dde3817ae8a9 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.163892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8651f-11b1-4bb7-9d3f-dde3817ae8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.164081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8651f-11b1-4bb7-9d3f-dde3817ae8a9 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.168763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 503/1021] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:39.171018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.171311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.171591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.190724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:39.192608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:39.204020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:39.273489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 519/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:39.548316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8651f-11b1-4bb7-9d3f-dde3817ae8a9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.558736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:39.659310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8651f-11b1-4bb7-9d3f-dde3817ae8a9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.697622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d837a2-15ff-48cf-8084-ccdfddd9aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.698274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d837a2-15ff-48cf-8084-ccdfddd9aa7a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.698555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d837a2-15ff-48cf-8084-ccdfddd9aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.698828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d837a2-15ff-48cf-8084-ccdfddd9aa7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.699990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d837a2-15ff-48cf-8084-ccdfddd9aa7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.701484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d837a2-15ff-48cf-8084-ccdfddd9aa7a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:39.703290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 504/1023] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:39.709898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:39.836958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8d05c-554d-4508-b1f7-89187f5c0d66 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:39.873072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:39.873687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.873968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.874243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.874908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:39.876355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:39.886443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b4f3-b70a-414b-b400-724c1d234dc8 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.886811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b4f3-b70a-414b-b400-724c1d234dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.887188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b4f3-b70a-414b-b400-724c1d234dc8 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.888584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 505/1024] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:39.895336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:39.895613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:39.895861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:39.898700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:39.909048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 520/1025] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:39.920115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:39.921405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:40.000818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 506/1026] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:40.275428 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.381692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5eb89-0696-45c0-94ef-86530f4022b4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.416945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.417587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.417865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.418137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] PATH_INFO: `/v3/services/image` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.418722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.420108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:40.430143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:40.431174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:40.432172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:40.436243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 521/1027] 10.222.0.45 () {56 vars in 1105 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:40.437271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.440434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:40.552888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500df17-6fe2-4eea-a5ba-8642853f659b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.589950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.590563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.590843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.591114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.591747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] RBAC: Adding query filter params (name=image) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:40.592048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.593449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.598987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 507/1028] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:40.604451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.671953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:40.715231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89806dd-7cb7-4e1a-a85a-ab20709fc942 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.751274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.751893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.752173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.752453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.753126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] RBAC: Adding query filter params (type=image) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:40.753485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.755402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.765578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 522/1029] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:40.767207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:40.842343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:40.884018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2ff45-73c6-4df4-a516-55281756587d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:40.919553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:40.920160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.920438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.920707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.921432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] RBAC: Adding query filter params (interface=public, service_id=7e4fe24a2cd544808c75141ada38b228, region_id=RegionOne) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:40.921733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:40.923137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59121e76-2d62-4633-9a71-e35a255b4c5c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:40.928977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 508/1030] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/endpoints?service_id=7e4fe24a2cd544808c75141ada38b228&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:40.934944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.045618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269603f-4cd2-4953-a4e2-5e6cfeb217ac None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.072911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.083459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303b3f-018d-49d3-887e-c8f64b272e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.084114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303b3f-018d-49d3-887e-c8f64b272e35 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.084398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303b3f-018d-49d3-887e-c8f64b272e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.084668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303b3f-018d-49d3-887e-c8f64b272e35 None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.085337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303b3f-018d-49d3-887e-c8f64b272e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.086713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303b3f-018d-49d3-887e-c8f64b272e35 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.100822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 523/1031] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:40 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:41.134892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f516c8-1c1a-4603-9fc5-86508c7373b2 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.135237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f516c8-1c1a-4603-9fc5-86508c7373b2 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.135521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f516c8-1c1a-4603-9fc5-86508c7373b2 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.137175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 509/1032] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:41.143157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.143444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.143749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.165487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:41.166720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:41.253225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 524/1033] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:41.530032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f516c8-1c1a-4603-9fc5-86508c7373b2 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.641326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f516c8-1c1a-4603-9fc5-86508c7373b2 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.673298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.680096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.680747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.681016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.681310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.692674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:41.697518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:41.698519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:41.699537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:41.706959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 510/1034] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:41.707122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.812520 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb1c28-14c3-479e-9fa5-ec2f8fe01cc7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.835674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.852177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.852816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.853096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.853365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.854037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:41.854390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.856036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.870169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 525/1035] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:41.871367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.983331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38788311-3410-45d5-a16b-b76750385ee5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.020324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.021079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.021361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.021631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.032046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.033520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:42.048836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:42.049877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:42.050822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:42.050822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:42.050822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:42.050822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 511/1036] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:42.056857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.180583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec99b-9bb6-4b7c-b87a-4e4cac873977 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.227816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.228426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.228702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.229000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.229905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:42.230206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.231589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb5e3e-f60e-48b0-a172-29cffb57467f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.249190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 526/1037] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:42.250625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.288557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6516-e9f0-4927-b0c6-c94c36948bca None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.288899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6516-e9f0-4927-b0c6-c94c36948bca None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.289153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c6516-e9f0-4927-b0c6-c94c36948bca None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.290500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 527/1038] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:42.295855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.296143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.296419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.307357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:42.315488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:42.316770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:42.359646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:42.383606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46ef75-094c-4548-96eb-117cb95cc70c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.398488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 528/1039] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:42.423854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.424476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.424781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.425053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.433649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.435081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:42.446525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:42.447659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:42.450222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:42.453529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.454101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 512/1040] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:42.565406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5250a-7acc-46fa-ab18-2c92c9c5af12 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.616508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.617146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.617418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.617687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.618401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:42.618698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.620127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.638372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 529/1041] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:42.643943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.683927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.720266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:42.765007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a536e-e5a4-4edb-8317-49fe0480f446 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.768927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:42.798940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a20eb-991b-44db-962c-9239d5febd20 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:42.807734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.808354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.808632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.808930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.836030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:42.836666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:42.836997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:42.837270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:42.849546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:42.854325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:42.855582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:42.856464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:42.860662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 530/1042] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:42.861510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:42.889100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:42.890712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:42.962714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:42.973353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5162e-1d71-44fd-b4cd-a04146bee5db None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.003079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 513/1043] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:43.008768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.014887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.021209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.021971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.022249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.022519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.023239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:43.023540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.024999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.039071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 531/1044] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:43.040246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.145862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc7d4e-9715-4436-b8da-ce45371990a6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.164819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5e8b2-64e1-4a0f-aba5-82375ded618f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.189410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.191211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.191944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.192598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.202549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.203191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.203469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.204127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] PATH_INFO: `/v3/users/1ded32e1caf7458084a984151e1a1cdb` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.205859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.208609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.220514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=1ded32e1caf7458084a984151e1a1cdb)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.222056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:43.223308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:43.224263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:43.225213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:43.225213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:43.225213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:43.228542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 532/1045] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/users/1ded32e1caf7458084a984151e1a1cdb => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:43.228926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 514/1046] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:43.229690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.230260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.245050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.301201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.347458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a78ee-2358-430a-9067-798be70fb1f6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.357933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136d03-fde2-41df-b206-a18ebf30943f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.385463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b8707-eb6d-498d-bec1-bf47d532b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.386466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b8707-eb6d-498d-bec1-bf47d532b447 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.386995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b8707-eb6d-498d-bec1-bf47d532b447 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.387515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b8707-eb6d-498d-bec1-bf47d532b447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.401542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.402379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.402766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.403084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.404012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:43.404512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.406830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad11880-4629-41d0-872c-8917439f0952 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.430588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 515/1047] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:43.431833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9e1a0-f0fc-4fd7-816a-f2fd92362e68 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.432121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9e1a0-f0fc-4fd7-816a-f2fd92362e68 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.432399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9e1a0-f0fc-4fd7-816a-f2fd92362e68 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.433767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 516/1048] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:43.434458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9e1a0-f0fc-4fd7-816a-f2fd92362e68 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.475286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b8707-eb6d-498d-bec1-bf47d532b447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.476782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b8707-eb6d-498d-bec1-bf47d532b447 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.488256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.538704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9e1a0-f0fc-4fd7-816a-f2fd92362e68 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.557800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.576375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.577101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.577379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.577649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.579121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 533/1049] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:43.580367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.580649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.580945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.590269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.591716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.599569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:43.600790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:43.604742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:43.605834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:43.606799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 517/1050] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:43.607335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.670400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 534/1051] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:43.671236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.717787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624c66b-984e-4564-97ec-e2e5f50e3079 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.722235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.755404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.756024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.756298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.756563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.757709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] RBAC: Authorizing `identity:get_project(project_id=dbbb6029c98047009d25142ce83f7a66)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.759124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.760769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 518/1052] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:43.766763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.782842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fae882-ff74-4ce7-a966-506b07332ccc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.818837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.821843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.822503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.822786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.823074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.824010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:43.824137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.825519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.837913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 535/1053] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:43.843615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.883791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34065025-ef3e-4a83-a614-02d1c1a408fc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:43.919976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:43.920643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.920893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.921164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.921892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=dbbb6029c98047009d25142ce83f7a66, user.id=1ded32e1caf7458084a984151e1a1cdb) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:43.922205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:43.923629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:43.930568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 519/1054] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/role_assignments?user.id=1ded32e1caf7458084a984151e1a1cdb&scope.project.id=dbbb6029c98047009d25142ce83f7a66&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:43.951393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:43.953071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:43.958264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc647-7ff6-4610-9505-bc830e778d9a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.000167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.000968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.001321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.001603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.002365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] RBAC: Adding query filter params (role.id=d75c510e5a00491f837a311fd38ce1b2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=464a6f0e27d642efb036de9164eeefc9) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:44.002661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.004181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.011444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 536/1055] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/role_assignments?user.id=464a6f0e27d642efb036de9164eeefc9&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d75c510e5a00491f837a311fd38ce1b2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:44.076314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3835cdf-5f94-4abc-8ea1-8972aa5004f6 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.088571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.129136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.129457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.129609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.129931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] PATH_INFO: `/v3/services/image` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.130830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.131938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:44.141596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:44.142944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:44.143938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 520/1056] 10.222.0.45 () {56 vars in 1105 bytes} [Tue Oct 4 08:34:43 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:44.149831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.263555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0faa2-7e62-41b0-ab40-abf2c6d21170 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.300215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.301212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.301505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.301785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.302416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] RBAC: Adding query filter params (name=image) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:44.302798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.304093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.312240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 537/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:44.315259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.427745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf1b3e-aace-453e-8c08-83a2aed4aa73 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.473416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.474118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.474403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.474676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.475318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:44.475618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.477059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0cf6-b246-4317-a26f-9486071317b0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.487052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 521/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:44.488638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.521131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.599329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548ac3-ca4d-4ed8-983b-3fd41a0f2dfa None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.635629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cf391-eeb0-443c-a724-136d1aa195ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.636237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cf391-eeb0-443c-a724-136d1aa195ab None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.636517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cf391-eeb0-443c-a724-136d1aa195ab None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.636816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cf391-eeb0-443c-a724-136d1aa195ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.637481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cf391-eeb0-443c-a724-136d1aa195ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.638865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cf391-eeb0-443c-a724-136d1aa195ab None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.668748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 538/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:46.162608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421d9f-71c3-4c2c-823c-6257ec66c0af None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.163158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421d9f-71c3-4c2c-823c-6257ec66c0af None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.163158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421d9f-71c3-4c2c-823c-6257ec66c0af None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.164661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 522/1060] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:46.169963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.170397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.170620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.189699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:46.190977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:46.208859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654fde-2488-4e03-90f9-5798241fad97 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.209151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654fde-2488-4e03-90f9-5798241fad97 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.209421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654fde-2488-4e03-90f9-5798241fad97 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.210895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 523/1061] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:46.215725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.216007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.216271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.235369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:46.236543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:46.269716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:46.276772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 539/1062] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:46.313068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 524/1063] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:46.543077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.556553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:46.578431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.656597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45081d-7647-4fcc-8f83-afed6882442a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:46.694569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cecdb8-657f-494c-aba4-0d898a7b14a4 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:46.694769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:46.695389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.695666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.695939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.708556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:46.713342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:46.714310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:46.715157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 540/1064] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:46.720481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.738917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:46.739868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.740355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.740871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.751857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:46.757481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:46.758465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:46.759362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 525/1065] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:46.765058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.797580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:46.811770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:46.848499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bf033-119c-4b82-82fa-efca495f62b8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:46.881695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaff1c7-0ee2-4b9f-9b4d-a42d931a7d9e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:46.886675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:46.887285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.887562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.887834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.888500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:46.888829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:46.890217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:46.901225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 541/1066] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:46.907009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:46.921349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:46.921957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.922239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.922508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.923167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:46.923467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:46.924916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47000238-0ca8-490e-b8cb-fb576b267f15 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:46.933953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 526/1067] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:46.934938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae463bf-cad4-49a0-87ea-d6c0cbcb257b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:46.935218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae463bf-cad4-49a0-87ea-d6c0cbcb257b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:46.935491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae463bf-cad4-49a0-87ea-d6c0cbcb257b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:46.936847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 527/1068] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:46.939616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae463bf-cad4-49a0-87ea-d6c0cbcb257b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.013868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a99bda-68d9-4195-b830-9da049805539 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.032088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.044386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.046503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae463bf-cad4-49a0-87ea-d6c0cbcb257b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.049981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207b130-1919-4a2a-88b4-a881a54fd70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.050580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207b130-1919-4a2a-88b4-a881a54fd70c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.050819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207b130-1919-4a2a-88b4-a881a54fd70c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.051117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207b130-1919-4a2a-88b4-a881a54fd70c None admin] PATH_INFO: `/v3/users/1ded32e1caf7458084a984151e1a1cdb` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.052235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207b130-1919-4a2a-88b4-a881a54fd70c None admin] RBAC: Authorizing `identity:get_user(user_id=1ded32e1caf7458084a984151e1a1cdb)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.053816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207b130-1919-4a2a-88b4-a881a54fd70c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.055399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 542/1069] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:46 2022] GET /identity/v3/users/1ded32e1caf7458084a984151e1a1cdb => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:47.057984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.058272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.058548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.077464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:47.078669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:47.083774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.084405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.084681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.084984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.095026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.096458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:47.111323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:47.112441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:47.113463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:47.113463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:47.113463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:47.113463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 528/1070] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:47.113463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.156993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 543/1071] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:47.157841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.224936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed9ac-74a9-4698-a687-3008626201f5 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.264156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.265132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.265630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.266089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.267299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8828-b1b3-40e8-aeb6-3c8803b69721 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.267945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] RBAC: Authorizing `identity:get_project(project_id=dbbb6029c98047009d25142ce83f7a66)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.270233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.271899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 529/1072] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:47.277673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.289470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.300451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.307546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.308421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.308912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.309421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.310367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:47.310840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.312476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.325960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 544/1073] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:47.331706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.392479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f640e8-ca1d-4eed-825a-586e34a31738 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.428839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.429512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.429790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.430088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66/users/1ded32e1caf7458084a984151e1a1cdb/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.432186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] RBAC: Authorizing `identity:create_grant(project_id=dbbb6029c98047009d25142ce83f7a66, user_id=1ded32e1caf7458084a984151e1a1cdb, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.433847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.441385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8093f-bcc2-47bb-b369-c37e601085c4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.447953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 530/1074] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:47 2022] PUT /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66/users/1ded32e1caf7458084a984151e1a1cdb/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:34:47.457408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.498123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.498866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.499180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.499411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.508960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.510452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:47.523451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:47.524681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:47.526063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 545/1075] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:47.530582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.565466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.598808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.608331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6140e-a71c-4221-8874-f2bbd426822a None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.652597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.653246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.653528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.653855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.670487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54348e0-4f4d-48ab-9bb1-ad0515a9dc12 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.710993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.711901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.712182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.712451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.713221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:47.713521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.715544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.733517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.735158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 546/1076] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:47.735276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.741271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.813094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.855230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 531/1077] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:47.861139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.871478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed9804-ce0b-4fc6-99d0-a3279fed1ff0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.882373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.913022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.914025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.914370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.914644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.926979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.929014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:47.945251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:47.946315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:47.947227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:47.947227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:47.947227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:47.951088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 547/1078] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:47.951986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.982067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69368e96-51ad-4e21-9036-f01dd0da72df None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.020763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.021400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.021789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.021984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.032710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.034882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:48.051686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:48.057824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:48.058797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:48.058797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:48.058797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:48.058797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 532/1079] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:48.058797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.068418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723846e3-184c-4b95-9e35-928e2d4c4fd1 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.080860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:48.111598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.112130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.112520 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.112989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.117035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:48.117035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.117035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.130512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 548/1080] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:48.136881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.161440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:48.176611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b15c5-aa32-4621-8e98-b5d08e265bcc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.221886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.222390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.222844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.224253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.224950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:48.225259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.226643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.252758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 533/1081] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:48.265945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95b549-596e-4077-a61d-db513af9aea4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.306194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.306836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.307113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.307388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.316168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.318181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:48.330667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:48.332137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:48.333161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:48.338507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 549/1082] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:48.338714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.435068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:48.456052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de478bb8-f678-484f-83b3-4a02f85428cc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.493286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.493900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.494178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.494446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.495136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:48.495442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.496899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb619c3-0f3d-49a3-906f-4463874077ef None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.510391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 534/1083] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:48.516487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.622255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:48.642774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccf6c3-0049-4c94-833c-56601bc9d26e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.677633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803bb7a-dadf-4d7e-b75b-47680d722681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.678286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803bb7a-dadf-4d7e-b75b-47680d722681 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.678565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803bb7a-dadf-4d7e-b75b-47680d722681 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.678838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803bb7a-dadf-4d7e-b75b-47680d722681 None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/464a6f0e27d642efb036de9164eeefc9/roles/d75c510e5a00491f837a311fd38ce1b2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.680974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803bb7a-dadf-4d7e-b75b-47680d722681 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=464a6f0e27d642efb036de9164eeefc9, role_id=d75c510e5a00491f837a311fd38ce1b2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.682416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803bb7a-dadf-4d7e-b75b-47680d722681 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.697104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 550/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:48 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/464a6f0e27d642efb036de9164eeefc9/roles/d75c510e5a00491f837a311fd38ce1b2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:49.656954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e609e7-c680-47f8-b6cf-cc5b02391905 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.657488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e609e7-c680-47f8-b6cf-cc5b02391905 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.657488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e609e7-c680-47f8-b6cf-cc5b02391905 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.658868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 535/1085] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:49.664541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:49.665005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:49.665125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:49.683619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:49.684816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:49.752559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 551/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:50.021695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e609e7-c680-47f8-b6cf-cc5b02391905 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.126937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e609e7-c680-47f8-b6cf-cc5b02391905 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.161297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.161926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.162198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.162465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.169809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.172903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:50.178445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:50.179595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:50.180600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 536/1087] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:50.185964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.254680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.289096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11586-a479-4ad0-88e9-3eadf75d3764 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.325022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.325630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.325925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.326172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.326826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:50.327125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.328489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.336802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 552/1088] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:50.342480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.443336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8c359-1725-4c52-a140-6503c7672b4f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.478326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.478951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.479479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.479750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] PATH_INFO: `/v3/users/1ded32e1caf7458084a984151e1a1cdb` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.480892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] RBAC: Authorizing `identity:get_user(user_id=1ded32e1caf7458084a984151e1a1cdb)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.482384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.483948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 537/1089] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/users/1ded32e1caf7458084a984151e1a1cdb => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:50.489995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.599076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b8f76-40ef-4761-a362-10d1f557632d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.628100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.633579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3195f-af61-416a-9459-a44cd6b72a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.634183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3195f-af61-416a-9459-a44cd6b72a7f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.634456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3195f-af61-416a-9459-a44cd6b72a7f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.634729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3195f-af61-416a-9459-a44cd6b72a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.701061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3195f-af61-416a-9459-a44cd6b72a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.702515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3195f-af61-416a-9459-a44cd6b72a7f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.805507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 553/1090] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:50.811372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.879211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.894052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ed133-6c98-46b4-9449-7188e168f648 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.894341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ed133-6c98-46b4-9449-7188e168f648 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.894647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ed133-6c98-46b4-9449-7188e168f648 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.895930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 554/1091] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:50.901046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.901335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.901613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.913466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae44dd-0eba-4c14-9f54-202a00b97912 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.919188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:50.920393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:50.946539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.946731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.947317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.947597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.947860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.949258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] RBAC: Authorizing `identity:get_project(project_id=dbbb6029c98047009d25142ce83f7a66)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.950673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.952291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 538/1092] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:50.958998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.991765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 555/1093] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:51.061000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7eaff0-5029-4692-88c4-b7e4dfd72033 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.097209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.097936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.098213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.098479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.099212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=dbbb6029c98047009d25142ce83f7a66, user.id=1ded32e1caf7458084a984151e1a1cdb) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:51.099512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.100986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.107364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:51.113095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 539/1094] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/role_assignments?user.id=1ded32e1caf7458084a984151e1a1cdb&scope.project.id=dbbb6029c98047009d25142ce83f7a66&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:51.269704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.382083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9d5f2-1d31-487a-968e-5705adb5380b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.416708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.417362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.417639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.417913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.429459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:51.434204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:51.435165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:51.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 556/1095] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:51.442281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.547457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb1577-978c-472c-ba1b-23ef011a6479 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.582945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.583553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.583831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.584229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.584789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:51.585091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.586449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.594708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 540/1096] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:51.606272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.634601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:51.712570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c5ba-6eec-47b8-b9aa-e8393cd2d59e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.748018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.748642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.748952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.749224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.760116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.761621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:51.777117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:51.778307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:51.779543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:51.779543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:51.779543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:51.779543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 557/1097] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:51.784644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.858628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:51.899589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb0b0-20bd-441c-ae33-31f5586c88aa None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.934909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.935517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.935795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.936064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.936699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:51.937024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.938374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.950748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 541/1098] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:51.956478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.037044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:52.063756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc79fc-2226-4ce0-a0b0-351ee808601e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.098622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.099248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.099529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.099803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.107979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.109609 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:52.121533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:52.122797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:34:52.129863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 558/1099] 10.222.0.45 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:52.130465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.230812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070bb9-1e01-4f11-9c17-b4f1ce09ae7e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.254295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:52.266376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.266988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.267274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.267543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.269090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:52.269547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.270973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.289548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 542/1100] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:52.295330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.395909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828947-44b7-4062-ba16-1ebdc9553475 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.434432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.435038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.435319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.435595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.438289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:52.505123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.506585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.605566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 559/1101] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:52.611338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.714191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b90f-c2f0-44ae-81ce-51eeb0d80211 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.750848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.751484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.751767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.752040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.763819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.765311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:52.780884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:52.781932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:52.782830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:52.782830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:52.782830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:52.782830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 543/1102] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:52.788065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.822907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:52.898309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8dbec-0c0f-4df4-b3da-e41e36452e80 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:52.935559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:52.936175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:52.936452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:52.936794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:52.937405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:52.937710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:52.939094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:52.950731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 560/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:52.957391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:52.990649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:53.062905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c5e5-5de6-4568-8a61-4f17d6bdb14f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.098623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.099256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.099532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.099795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.107211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.108647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:53.121092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:53.122380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:34:53.123959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 544/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:53.134899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.231316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:53.239390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a5ca-f7a9-4fb1-8e3f-8a0ded20983a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.279162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.279776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.280054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.280328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.281060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:53.281365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.282814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b65104-38e4-4d95-86a7-bec37c39b6fb None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.296293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 561/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:53.302774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.366755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4b94-3ea0-4397-a7d7-c195b3b7f446 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.367034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4b94-3ea0-4397-a7d7-c195b3b7f446 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.367314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4b94-3ea0-4397-a7d7-c195b3b7f446 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.368625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 562/1106] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:53.374002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.374279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.374557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.392828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:53.394616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:53.397653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:53.406977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532dbea-2a5c-4cbc-92e5-e620b7f7d3ef None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.443353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.443961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.444240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.444509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.445266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] RBAC: Adding query filter params (role.id=d75c510e5a00491f837a311fd38ce1b2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=464a6f0e27d642efb036de9164eeefc9) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:53.445575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.446993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.453456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 545/1107] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:53 2022] GET /identity/v3/role_assignments?user.id=464a6f0e27d642efb036de9164eeefc9&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d75c510e5a00491f837a311fd38ce1b2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:53.476247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 563/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:53.755090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.860939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160e5e-2641-4136-9a56-57128d992f30 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:53.897861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb14b6-16bd-4f45-8ac4-11c8ba835fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:53.898510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb14b6-16bd-4f45-8ac4-11c8ba835fc7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.898786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb14b6-16bd-4f45-8ac4-11c8ba835fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.899057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb14b6-16bd-4f45-8ac4-11c8ba835fc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.900173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb14b6-16bd-4f45-8ac4-11c8ba835fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:53.901639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb14b6-16bd-4f45-8ac4-11c8ba835fc7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:53.903220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 546/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:53.909246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:53.999734 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:54.017682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6ccbd-6810-476e-b193-426ca6c3b378 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:54.058392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9418d1-67fd-4a82-a1ff-63613e8c614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:54.059279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9418d1-67fd-4a82-a1ff-63613e8c614f None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.059558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9418d1-67fd-4a82-a1ff-63613e8c614f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.059834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9418d1-67fd-4a82-a1ff-63613e8c614f None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.060514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9418d1-67fd-4a82-a1ff-63613e8c614f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:54.062012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9418d1-67fd-4a82-a1ff-63613e8c614f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:54.087565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 564/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:34:53 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:56.357788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a131-e0d6-417a-ad0d-c7520a061374 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.358354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a131-e0d6-417a-ad0d-c7520a061374 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.358354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a131-e0d6-417a-ad0d-c7520a061374 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.359703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 547/1111] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:56.365603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.366047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.366153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.384246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:56.385402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.453890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 565/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:56.733651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a131-e0d6-417a-ad0d-c7520a061374 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.760204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:56.837117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a131-e0d6-417a-ad0d-c7520a061374 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:56.871028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:56.871654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.871934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.872208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] PATH_INFO: `/v3/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.873621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] RBAC: Authorizing `identity:get_role(role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:56.874990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:56.876315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 548/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/roles/073ad24837f74fb6979813d89b0e171f => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:56.886843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:56.956947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:56.990607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e888ee-d152-424d-b24c-7787f19bfc0a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.023799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.024431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.024735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.025015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] PATH_INFO: `/v3/users/601e7478635a43609778c72d608b3dbd` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.039196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] RBAC: Authorizing `identity:get_user(user_id=601e7478635a43609778c72d608b3dbd)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.040654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.042333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 566/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/users/601e7478635a43609778c72d608b3dbd => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:57.048161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.140342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.150186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bac693-253b-4fe2-8938-489c0fd8ff43 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.184064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.184659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.184968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.185240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.251450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.253026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.339613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.349586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 549/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:57.355844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.455429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c20f86-dae0-45bc-b968-ec9d42866249 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.486347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.496232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cdb7e-6078-438b-9dc5-ab90f1d20b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.497042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cdb7e-6078-438b-9dc5-ab90f1d20b33 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.497322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cdb7e-6078-438b-9dc5-ab90f1d20b33 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.497589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cdb7e-6078-438b-9dc5-ab90f1d20b33 None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.498786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cdb7e-6078-438b-9dc5-ab90f1d20b33 None admin] RBAC: Authorizing `identity:get_project(project_id=dbbb6029c98047009d25142ce83f7a66)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.500255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cdb7e-6078-438b-9dc5-ab90f1d20b33 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.502096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 567/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:57 2022] GET /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:57.509237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.607018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe3274-7243-485c-b01a-d0cfc29574db None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.640096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.640790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.641070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.641340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.642058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] RBAC: Adding query filter params (role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=dbbb6029c98047009d25142ce83f7a66, user.id=601e7478635a43609778c72d608b3dbd) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:57.642363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.644024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4944873-a70b-43f1-a501-0bd7d552c8a4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.649475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 550/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:57 2022] GET /identity/v3/role_assignments?user.id=601e7478635a43609778c72d608b3dbd&scope.project.id=dbbb6029c98047009d25142ce83f7a66&role.id=073ad24837f74fb6979813d89b0e171f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:59.793630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89695-6fe8-427e-a1ce-fbe67b4ed4d9 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.794169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89695-6fe8-427e-a1ce-fbe67b4ed4d9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.794169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89695-6fe8-427e-a1ce-fbe67b4ed4d9 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.795494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 568/1118] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:59.801249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.801731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.801827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.820459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:59.821691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.870955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:59.888172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 551/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:00.163328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c89695-6fe8-427e-a1ce-fbe67b4ed4d9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.270804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c89695-6fe8-427e-a1ce-fbe67b4ed4d9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.304618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.307634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.307634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.307634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] PATH_INFO: `/v3/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.307634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] RBAC: Authorizing `identity:get_role(role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.308555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.309914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 569/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/roles/073ad24837f74fb6979813d89b0e171f => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.315780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.422581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f90f-aa1c-48bf-8f56-931ba06c610c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.459901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.460543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.460860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.461139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] PATH_INFO: `/v3/users/601e7478635a43609778c72d608b3dbd` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.462319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] RBAC: Authorizing `identity:get_user(user_id=601e7478635a43609778c72d608b3dbd)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.463776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.465452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 552/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/users/601e7478635a43609778c72d608b3dbd => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.472241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.534206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.577024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87875fb-71a0-4122-88d1-66dd47b9d2a1 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.614124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d671d-1ab7-41bd-b571-e1507b7e6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.614748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d671d-1ab7-41bd-b571-e1507b7e6c24 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.615029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d671d-1ab7-41bd-b571-e1507b7e6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.615304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d671d-1ab7-41bd-b571-e1507b7e6c24 None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.616422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d671d-1ab7-41bd-b571-e1507b7e6c24 None admin] RBAC: Authorizing `identity:get_project(project_id=dbbb6029c98047009d25142ce83f7a66)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.617899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d671d-1ab7-41bd-b571-e1507b7e6c24 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.619527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 570/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.625615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.680989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.725438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b3cdb-1311-476f-996e-9ba76561f651 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.758123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dc739-389c-4fb7-9c8d-ac92a8eb8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.758767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc739-389c-4fb7-9c8d-ac92a8eb8089 None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.759044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc739-389c-4fb7-9c8d-ac92a8eb8089 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.759310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc739-389c-4fb7-9c8d-ac92a8eb8089 None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66/users/601e7478635a43609778c72d608b3dbd/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.761409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dc739-389c-4fb7-9c8d-ac92a8eb8089 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbbb6029c98047009d25142ce83f7a66, user_id=601e7478635a43609778c72d608b3dbd, role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.762817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dc739-389c-4fb7-9c8d-ac92a8eb8089 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.775580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 553/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:35:00 2022] PUT /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66/users/601e7478635a43609778c72d608b3dbd/roles/073ad24837f74fb6979813d89b0e171f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:03.967401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9805-efd3-4e20-9780-431d1beb417c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.967996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9805-efd3-4e20-9780-431d1beb417c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.967996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db9805-efd3-4e20-9780-431d1beb417c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.969468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 571/1124] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:03.975847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.976383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.976383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.997064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:03.998323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:04.077159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 554/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:35:04.359099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9805-efd3-4e20-9780-431d1beb417c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.471151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db9805-efd3-4e20-9780-431d1beb417c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.504182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:04.510520 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.511211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.511532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.511838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] PATH_INFO: `/v3/roles/073ad24837f74fb6979813d89b0e171f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.513357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] RBAC: Authorizing `identity:get_role(role_id=073ad24837f74fb6979813d89b0e171f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.514796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.516209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 572/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:04 2022] GET /identity/v3/roles/073ad24837f74fb6979813d89b0e171f => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:04.522602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.573882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:04.643634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf974f6f-0580-42a0-b778-302a03b5fd06 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.680971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.681657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.681973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.682282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] PATH_INFO: `/v3/users/601e7478635a43609778c72d608b3dbd` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.683532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=601e7478635a43609778c72d608b3dbd)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.685084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.686786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 555/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:04 2022] GET /identity/v3/users/601e7478635a43609778c72d608b3dbd => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:04.693598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:04.803606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a648357-9cbf-441d-9c97-b431d7425926 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.842681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.843304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.843581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.843849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.920566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:04.923941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.926150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.041664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 573/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:05.050914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:05.160738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997289a-f4b5-4af1-b2e5-d74fcecdc7e0 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:05.174336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:05.196052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61a29f-5fad-478d-8abe-9752eaf181a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:05.196686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a29f-5fad-478d-8abe-9752eaf181a1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.196989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a29f-5fad-478d-8abe-9752eaf181a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.197258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61a29f-5fad-478d-8abe-9752eaf181a1 None admin] PATH_INFO: `/v3/projects/dbbb6029c98047009d25142ce83f7a66` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.198428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61a29f-5fad-478d-8abe-9752eaf181a1 None admin] RBAC: Authorizing `identity:get_project(project_id=dbbb6029c98047009d25142ce83f7a66)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:05.199863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61a29f-5fad-478d-8abe-9752eaf181a1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.201607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 556/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:05 2022] GET /identity/v3/projects/dbbb6029c98047009d25142ce83f7a66 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:05.208594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:05.309188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:05.313036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3776-ea5c-458e-aa95-0c7aedb03bd4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:05.371203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:05.372212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:05.372739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:05.373241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:05.374590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] RBAC: Adding query filter params (role.id=073ad24837f74fb6979813d89b0e171f, scope.project.id=dbbb6029c98047009d25142ce83f7a66, user.id=601e7478635a43609778c72d608b3dbd) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:05.375098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:05.378797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac31dc-cd00-4f74-b55b-f1e9540df884 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:05.389153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 574/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:05 2022] GET /identity/v3/role_assignments?user.id=601e7478635a43609778c72d608b3dbd&scope.project.id=dbbb6029c98047009d25142ce83f7a66&role.id=073ad24837f74fb6979813d89b0e171f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:07.655498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4659-a23c-4fb3-a8d3-4c8d2b940a64 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.656119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4659-a23c-4fb3-a8d3-4c8d2b940a64 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.656436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b4659-a23c-4fb3-a8d3-4c8d2b940a64 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.658893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 557/1131] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:07.667535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.668115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.668115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.689190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:07.691294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:07.768752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 575/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:08.040264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4659-a23c-4fb3-a8d3-4c8d2b940a64 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:08.157312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b4659-a23c-4fb3-a8d3-4c8d2b940a64 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:08.202464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d03b57-3fa9-43f2-8584-6533e80df85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:08.203122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d03b57-3fa9-43f2-8584-6533e80df85a None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:08.203398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d03b57-3fa9-43f2-8584-6533e80df85a None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:08.203666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d03b57-3fa9-43f2-8584-6533e80df85a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:08.205572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d03b57-3fa9-43f2-8584-6533e80df85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:08.207259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d03b57-3fa9-43f2-8584-6533e80df85a None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:08.209002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 558/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:08.215206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:08.321073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:08.328805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627ca4-1699-4b85-b4f7-65edb1ae676b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:08.382053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faab65-dc83-4724-8735-46de0400200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:08.382685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faab65-dc83-4724-8735-46de0400200e None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:08.382964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faab65-dc83-4724-8735-46de0400200e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:08.383236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faab65-dc83-4724-8735-46de0400200e None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:08.383909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faab65-dc83-4724-8735-46de0400200e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:08.385405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5faab65-dc83-4724-8735-46de0400200e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:08.418011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 576/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:35:08 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:10.778507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963927cd-8110-4fed-a40d-42c9a191ae74 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.779103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963927cd-8110-4fed-a40d-42c9a191ae74 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.779103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963927cd-8110-4fed-a40d-42c9a191ae74 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.780438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 559/1135] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:35:10.787111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.787723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.787723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.808884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:10.810141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:10.888450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 577/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:35:11.174306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963927cd-8110-4fed-a40d-42c9a191ae74 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:11.233690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:11.291239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963927cd-8110-4fed-a40d-42c9a191ae74 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:11.330293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fdab5-a838-4b85-946c-be306fc51db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:11.330950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fdab5-a838-4b85-946c-be306fc51db2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:11.331225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fdab5-a838-4b85-946c-be306fc51db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:11.331486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fdab5-a838-4b85-946c-be306fc51db2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.332805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fdab5-a838-4b85-946c-be306fc51db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:11.334300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fdab5-a838-4b85-946c-be306fc51db2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:11.335952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 560/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:11.342027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:11.426967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:11.453065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81df49d-1b9b-4b6c-90aa-17808ee6cf14 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:11.492292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733255a2-18fc-4365-bddd-02b0d3534e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:11.493004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733255a2-18fc-4365-bddd-02b0d3534e8b None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:11.493289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733255a2-18fc-4365-bddd-02b0d3534e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:11.493565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733255a2-18fc-4365-bddd-02b0d3534e8b None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:11.494236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733255a2-18fc-4365-bddd-02b0d3534e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:11.495718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733255a2-18fc-4365-bddd-02b0d3534e8b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:11.520301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 578/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:35:11 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:13.922431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f5b40-b3b1-4b61-9d26-db0f2ce4a177 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:13.923040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f5b40-b3b1-4b61-9d26-db0f2ce4a177 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:13.923040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f5b40-b3b1-4b61-9d26-db0f2ce4a177 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:13.925217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 561/1139] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:35:13.933973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:13.934537 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:13.934639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:13.956063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:13.957458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:14.036583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 579/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:14.324152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f5b40-b3b1-4b61-9d26-db0f2ce4a177 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:14.521814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f5b40-b3b1-4b61-9d26-db0f2ce4a177 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:14.540527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:14.562259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:14.562902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:14.563181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:14.563453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:14.581556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:14.589746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:14.592079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:35:14.594257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 562/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:14.599124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:14.668831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:14.717098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e2797-a8ab-4cdb-8d13-318217739919 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:14.759018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:14.759639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:14.759916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:14.760188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:14.760898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:14.761201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:14.762615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:14.773807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 580/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:14.780117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:14.899823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac687a20-37c4-44ce-8e5a-97a3dcc15c59 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:14.938193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:14.938970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:14.939252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:14.939742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] PATH_INFO: `/v3/users/ff9dd3734c67421792113806f5c3b5dc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:14.956975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] RBAC: Authorizing `identity:get_user(user_id=ff9dd3734c67421792113806f5c3b5dc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:14.958452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:14.960212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 563/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:14 2022] GET /identity/v3/users/ff9dd3734c67421792113806f5c3b5dc => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:14.966402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:15.088661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb0b8-3429-45ff-b2ca-c0279546cfa3 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:15.119064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:15.132750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:15.133435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.133795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.134070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.214634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:15.216076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:15.329266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 581/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:15.336505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:15.377262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:15.456409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9cc6a-9f82-4d0e-840f-c3056db5788c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:15.497341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ca30a-3f73-4170-9726-6a35d6846da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:15.497910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ca30a-3f73-4170-9726-6a35d6846da1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.498183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ca30a-3f73-4170-9726-6a35d6846da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.498482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ca30a-3f73-4170-9726-6a35d6846da1 None admin] PATH_INFO: `/v3/projects/d310323d684c458399bea8030a50bf3f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.499914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ca30a-3f73-4170-9726-6a35d6846da1 None admin] RBAC: Authorizing `identity:get_project(project_id=d310323d684c458399bea8030a50bf3f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:15.501497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ca30a-3f73-4170-9726-6a35d6846da1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:15.503385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 564/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:15 2022] GET /identity/v3/projects/d310323d684c458399bea8030a50bf3f => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:15.510667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:15.557594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:15.664001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a80b3-0277-4282-9b63-1e794b74b7e2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:15.706751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:15.707375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.707654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.707926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.708685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=d310323d684c458399bea8030a50bf3f, user.id=ff9dd3734c67421792113806f5c3b5dc) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:15.709030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:15.710565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e1cd-5531-4a53-aa5a-898eea1d643e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:15.717261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 582/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:15 2022] GET /identity/v3/role_assignments?user.id=ff9dd3734c67421792113806f5c3b5dc&scope.project.id=d310323d684c458399bea8030a50bf3f&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:18.121168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39dbb-4e8f-4054-b880-9940eadc4e82 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.121719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39dbb-4e8f-4054-b880-9940eadc4e82 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.121719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39dbb-4e8f-4054-b880-9940eadc4e82 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.123227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 565/1147] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:18.130056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.130659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.130659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.150378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:18.151636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.230070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 583/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:35:18.510951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39dbb-4e8f-4054-b880-9940eadc4e82 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:18.640641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39dbb-4e8f-4054-b880-9940eadc4e82 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:18.643166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:18.684167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:18.684855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.685135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.685405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.699274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:18.704847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:18.706634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:35:18.708009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 566/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:35:18.716344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:18.737028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:18.839160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a9b80-759a-4dd5-8346-bc1bc4c31ddf None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:18.882011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:18.882628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.882907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.883178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.883860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:18.884179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:18.885600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:18.895847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 584/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:18.904623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.069859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d8eb-934a-4e15-ace3-933bce0f3982 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.116172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.116747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.117036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.117305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] PATH_INFO: `/v3/users/ff9dd3734c67421792113806f5c3b5dc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.118561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9dd3734c67421792113806f5c3b5dc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.120181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.121743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 567/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:18 2022] GET /identity/v3/users/ff9dd3734c67421792113806f5c3b5dc => generated 286 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:19.128180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.226012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:19.250428 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b7b40-a2e7-4d44-8ccb-ed8be8d919c5 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.290654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90699e-706a-4db8-b2aa-10552c4c3da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.291362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90699e-706a-4db8-b2aa-10552c4c3da2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.291682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90699e-706a-4db8-b2aa-10552c4c3da2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.291997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90699e-706a-4db8-b2aa-10552c4c3da2 None admin] PATH_INFO: `/v3/projects/d310323d684c458399bea8030a50bf3f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.293269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90699e-706a-4db8-b2aa-10552c4c3da2 None admin] RBAC: Authorizing `identity:get_project(project_id=d310323d684c458399bea8030a50bf3f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.294780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90699e-706a-4db8-b2aa-10552c4c3da2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.296537 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 585/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:19 2022] GET /identity/v3/projects/d310323d684c458399bea8030a50bf3f => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:19.303246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.340142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:19.439758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4568-d386-4033-935d-53964bfe3700 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.480374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f209d10-8560-4400-98bd-80bb505813dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.481108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f209d10-8560-4400-98bd-80bb505813dd None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.481382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f209d10-8560-4400-98bd-80bb505813dd None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.481653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f209d10-8560-4400-98bd-80bb505813dd None admin] PATH_INFO: `/v3/projects/d310323d684c458399bea8030a50bf3f/users/ff9dd3734c67421792113806f5c3b5dc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.483720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f209d10-8560-4400-98bd-80bb505813dd None admin] RBAC: Authorizing `identity:create_grant(project_id=d310323d684c458399bea8030a50bf3f, user_id=ff9dd3734c67421792113806f5c3b5dc, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.485259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f209d10-8560-4400-98bd-80bb505813dd None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.502086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 568/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:35:19 2022] PUT /identity/v3/projects/d310323d684c458399bea8030a50bf3f/users/ff9dd3734c67421792113806f5c3b5dc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:21.835272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7318-3d29-47a6-bce7-1ed3e7b1a2f4 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.835887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7318-3d29-47a6-bce7-1ed3e7b1a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.835887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7318-3d29-47a6-bce7-1ed3e7b1a2f4 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.837238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 586/1154] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:35:21.843803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.844383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.844383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.866081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:21.867358 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.951114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 569/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:22.235973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7318-3d29-47a6-bce7-1ed3e7b1a2f4 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.364948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7318-3d29-47a6-bce7-1ed3e7b1a2f4 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.407800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.409100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.409387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.409660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.422541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:22.429199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:22.430894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:35:22.431792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 587/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:35:22.437148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.461046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.553826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc218cc-91b7-4fd0-b45d-52371c988295 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.593395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.594014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.594293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.594568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.595871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:22.596165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.597590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.607076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 570/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:22.617391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.630841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.732987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deafb14-bae9-4c17-a963-c1ee4d42f328 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.774555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.775193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.775469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.775737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] PATH_INFO: `/v3/users/ff9dd3734c67421792113806f5c3b5dc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.777105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9dd3734c67421792113806f5c3b5dc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.778566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.780229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 588/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/users/ff9dd3734c67421792113806f5c3b5dc => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:22.786910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.887756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.910491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817be346-737e-478c-a6d1-a64df6b5cde9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.950373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.950998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.951279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.951551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.033865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.035358 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.131413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:23.153368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 571/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:35:23.161229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.252206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:23.279080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa52a5-7ab2-4a4e-95f0-5774d9331190 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.319904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f98a38-098a-4009-a301-77132e6b1b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.320447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f98a38-098a-4009-a301-77132e6b1b3a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.320757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f98a38-098a-4009-a301-77132e6b1b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.321020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f98a38-098a-4009-a301-77132e6b1b3a None admin] PATH_INFO: `/v3/projects/d310323d684c458399bea8030a50bf3f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.322220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f98a38-098a-4009-a301-77132e6b1b3a None admin] RBAC: Authorizing `identity:get_project(project_id=d310323d684c458399bea8030a50bf3f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.323679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f98a38-098a-4009-a301-77132e6b1b3a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.325451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 589/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:23 2022] GET /identity/v3/projects/d310323d684c458399bea8030a50bf3f => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:23.335580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:23.453216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057355-83e5-444c-839c-7b8a51e34ca9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:23.494259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:23.494887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:23.495164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:23.495437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:23.496185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=d310323d684c458399bea8030a50bf3f, user.id=ff9dd3734c67421792113806f5c3b5dc) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:23.496494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:23.497988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeab66-75d2-4b51-a093-a92b9854f913 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:23.505274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 572/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:23 2022] GET /identity/v3/role_assignments?user.id=ff9dd3734c67421792113806f5c3b5dc&scope.project.id=d310323d684c458399bea8030a50bf3f&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:25.920136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63969897-fb52-45fa-b831-f0d5d3b7d72b None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.920765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63969897-fb52-45fa-b831-f0d5d3b7d72b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.920765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63969897-fb52-45fa-b831-f0d5d3b7d72b None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.922053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 590/1162] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:25.928591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.929176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.929176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.949433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:25.950668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:25.997843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:26.025533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 573/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:26.304081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63969897-fb52-45fa-b831-f0d5d3b7d72b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:26.426498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63969897-fb52-45fa-b831-f0d5d3b7d72b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:26.465571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:26.466495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:26.466974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:26.467258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:26.488465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:26.560155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:26.561585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:26.677141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 591/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:35:26.683638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:26.797260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad83cda-3e56-4aff-aed6-0d830d8bbd00 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:26.839902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:26.840661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:26.842378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:26.842849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:26.856322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:26.857965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-0f06f007-dcf0-489c-a0c1-e1e8efeac151 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:26.872431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:26.874660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:35:26.876512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 574/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:35:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:26.882413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:26.935168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:27.002583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13270a1f-3711-4245-b562-9bc552d66dca None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:27.041256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:27.041881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:27.042163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:27.042436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:27.043105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:27.043410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:27.044873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208c805-c8ae-493d-99b0-e29be88fa695 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:27.053897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 592/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Tue Oct 4 08:35:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:29.356187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22591b-43f2-4183-86c7-35468256016e None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.356782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22591b-43f2-4183-86c7-35468256016e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.357116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22591b-43f2-4183-86c7-35468256016e None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.359638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 575/1167] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:29.366377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d833df4-90c9-4c03-9500-1123aea03bd2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.366987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d833df4-90c9-4c03-9500-1123aea03bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.366987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d833df4-90c9-4c03-9500-1123aea03bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.386885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9d833df4-90c9-4c03-9500-1123aea03bd2 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:29.388026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9d833df4-90c9-4c03-9500-1123aea03bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:29.489282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 593/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:29.782115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22591b-43f2-4183-86c7-35468256016e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.826061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:29.917093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22591b-43f2-4183-86c7-35468256016e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.980261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbaff0-14c6-4106-8146-5f0ab72a7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.981413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbaff0-14c6-4106-8146-5f0ab72a7620 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.981899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbaff0-14c6-4106-8146-5f0ab72a7620 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.982382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbaff0-14c6-4106-8146-5f0ab72a7620 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.983649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbaff0-14c6-4106-8146-5f0ab72a7620 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.986270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbaff0-14c6-4106-8146-5f0ab72a7620 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:30.009096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 576/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Tue Oct 4 08:35:29 2022] POST /identity/v3/domains => generated 267 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:35:32.566231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f6de2-549c-4278-b1e1-acd701695b42 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.566841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f6de2-549c-4278-b1e1-acd701695b42 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.567121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f6de2-549c-4278-b1e1-acd701695b42 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.569672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 594/1170] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:32.575899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6807564-0578-4022-8043-1807530b4974 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:32.576702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6807564-0578-4022-8043-1807530b4974 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:32.576702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6807564-0578-4022-8043-1807530b4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:32.598873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d6807564-0578-4022-8043-1807530b4974 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:32.600103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d6807564-0578-4022-8043-1807530b4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:32.702217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 577/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:35:32.982879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f6de2-549c-4278-b1e1-acd701695b42 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.035338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:33.107603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f6de2-549c-4278-b1e1-acd701695b42 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.149953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4226fb-5a22-4145-ae1f-0b5770c18e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.150747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4226fb-5a22-4145-ae1f-0b5770c18e06 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.151131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4226fb-5a22-4145-ae1f-0b5770c18e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.151491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4226fb-5a22-4145-ae1f-0b5770c18e06 None admin] PATH_INFO: `/v3/domains/5f083c5bbcdd45e5894c87198dfb700d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.164973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4226fb-5a22-4145-ae1f-0b5770c18e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f083c5bbcdd45e5894c87198dfb700d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.166476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4226fb-5a22-4145-ae1f-0b5770c18e06 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.168433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 595/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Tue Oct 4 08:35:32 2022] GET /identity/v3/domains/5f083c5bbcdd45e5894c87198dfb700d => generated 267 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:33.175221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6807564-0578-4022-8043-1807530b4974 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:33.209501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:33.304014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6807564-0578-4022-8043-1807530b4974 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:33.351606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a1b9a-325a-4047-99dd-fccd72892491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:33.352403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a1b9a-325a-4047-99dd-fccd72892491 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:33.352769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a1b9a-325a-4047-99dd-fccd72892491 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:33.353303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a1b9a-325a-4047-99dd-fccd72892491 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:33.354008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a1b9a-325a-4047-99dd-fccd72892491 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:33.355613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a1b9a-325a-4047-99dd-fccd72892491 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:33.390060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 578/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:35:33 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:35.976365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9366d-d986-4dad-bfc0-bcd0ee32b3bf None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.977036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9366d-d986-4dad-bfc0-bcd0ee32b3bf None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.977400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9366d-d986-4dad-bfc0-bcd0ee32b3bf None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:35.980471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 596/1174] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:35.987446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:35.988040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:35.988284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:36.017009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:36.018679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:36.128285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 579/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:36.509026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9366d-d986-4dad-bfc0-bcd0ee32b3bf None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:36.650511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:36.660165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9366d-d986-4dad-bfc0-bcd0ee32b3bf None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:36.709909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80f69a-4c61-4cd8-994d-ae254f299b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:36.710572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80f69a-4c61-4cd8-994d-ae254f299b5a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:36.710842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80f69a-4c61-4cd8-994d-ae254f299b5a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:36.711117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80f69a-4c61-4cd8-994d-ae254f299b5a None admin] PATH_INFO: `/v3/domains/5f083c5bbcdd45e5894c87198dfb700d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:36.712449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80f69a-4c61-4cd8-994d-ae254f299b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f083c5bbcdd45e5894c87198dfb700d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:36.713941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80f69a-4c61-4cd8-994d-ae254f299b5a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:36.716007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 597/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Tue Oct 4 08:35:36 2022] GET /identity/v3/domains/5f083c5bbcdd45e5894c87198dfb700d => generated 267 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:36.722851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:36.738689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:36.864896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46033719-0171-4fda-9aa5-ee7ba0876f32 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:36.928834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e082eb9-e61e-47a5-986c-6a35544cedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:36.929570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082eb9-e61e-47a5-986c-6a35544cedb5 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:36.929924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082eb9-e61e-47a5-986c-6a35544cedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:36.930194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082eb9-e61e-47a5-986c-6a35544cedb5 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:36.930881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e082eb9-e61e-47a5-986c-6a35544cedb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:36.932478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e082eb9-e61e-47a5-986c-6a35544cedb5 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:36.957916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 580/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:35:36 2022] POST /identity/v3/users => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:39.306844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31f37-1d84-4b63-9ec3-db7d66794a54 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.307456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31f37-1d84-4b63-9ec3-db7d66794a54 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.307456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b31f37-1d84-4b63-9ec3-db7d66794a54 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.308923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 598/1178] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:39.315306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.315852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.315983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.336356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:39.337627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:39.415579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:39.426878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 581/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:39.706755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b31f37-1d84-4b63-9ec3-db7d66794a54 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:39.829949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b31f37-1d84-4b63-9ec3-db7d66794a54 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:39.870425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:39.871043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:39.871363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:39.871672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:39.884020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:39.889997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:39.892452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:35:39.893536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 599/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:39.899247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.027880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c9caa-63a8-48ba-b849-783945f22fe7 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.079555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.080498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.080810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.081088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.081774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:40.082075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.083912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.096151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 582/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:40.106511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.141234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:40.231623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4455cb-b34f-47dc-b29c-825a1edd1087 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.273293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.274047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.274325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.274593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] PATH_INFO: `/v3/users/b3b245681fd64111a36b6a7c137b0d9c` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.291791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] RBAC: Authorizing `identity:get_user(user_id=b3b245681fd64111a36b6a7c137b0d9c)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.293399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.295210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 600/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:40 2022] GET /identity/v3/users/b3b245681fd64111a36b6a7c137b0d9c => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:40.301627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.407239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:40.483159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c76ed-d1dd-4105-8770-ee71c9591f52 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:40.523516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:40.524203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:40.524529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:40.524872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:40.640225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:40.644603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:40.731832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:40.792049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 583/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:40.802334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:40.972475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:41.002539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3e01a-0336-49b3-82a8-9cc5d172533a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:41.082207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1885-43ee-43c3-a6ba-dfaff60cb48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:41.083088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1885-43ee-43c3-a6ba-dfaff60cb48a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.083525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1885-43ee-43c3-a6ba-dfaff60cb48a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.083836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1885-43ee-43c3-a6ba-dfaff60cb48a None admin] PATH_INFO: `/v3/projects/eda7224c979a4ec5afdb31dd26b93633` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.085548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c1885-43ee-43c3-a6ba-dfaff60cb48a None admin] RBAC: Authorizing `identity:get_project(project_id=eda7224c979a4ec5afdb31dd26b93633)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:41.087132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c1885-43ee-43c3-a6ba-dfaff60cb48a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:41.089128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 601/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:40 2022] GET /identity/v3/projects/eda7224c979a4ec5afdb31dd26b93633 => generated 361 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:41.104373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:41.290524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3cd54-d9ca-45d8-b058-dd05262a4d56 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:41.347522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:41.348211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:41.348455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:41.348739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:41.349500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=eda7224c979a4ec5afdb31dd26b93633, user.id=b3b245681fd64111a36b6a7c137b0d9c) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:41.349811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:41.351284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f774ef-1a52-4624-8386-87305f8b0359 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:41.358258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 584/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:41 2022] GET /identity/v3/role_assignments?user.id=b3b245681fd64111a36b6a7c137b0d9c&scope.project.id=eda7224c979a4ec5afdb31dd26b93633&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:43.892508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb845a7-00b9-4d9b-84ea-39d3deeb32e5 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.893354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb845a7-00b9-4d9b-84ea-39d3deeb32e5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.893354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb845a7-00b9-4d9b-84ea-39d3deeb32e5 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.894640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 602/1186] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:35:43.900608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:43.901243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:43.901243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:43.920279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:43.922163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:43.939682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.009316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 585/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:44.291897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb845a7-00b9-4d9b-84ea-39d3deeb32e5 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.401431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb845a7-00b9-4d9b-84ea-39d3deeb32e5 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.439638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.440280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.440561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.440867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.452282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:44.457281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:44.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:35:44.459561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 603/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:35:44.465263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.566986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524136d7-96e9-46c8-8550-d117e6c9dfa1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.606828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.607451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.607728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.607998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.608677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:44.609600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.611441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.620558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 586/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:44.628115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.644347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.738078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c9be-24dc-41fe-a55f-4e12c085088b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.789837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.790919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.791424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.791928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] PATH_INFO: `/v3/users/b3b245681fd64111a36b6a7c137b0d9c` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.793931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] RBAC: Authorizing `identity:get_user(user_id=b3b245681fd64111a36b6a7c137b0d9c)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.796791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:44.799843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 604/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/users/b3b245681fd64111a36b6a7c137b0d9c => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:44.806069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:44.824751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:44.931280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429c85e-1645-4325-b7a5-879ad280db4e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:44.989538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3e61e-63fc-4639-ba88-28153c7c9476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:44.990566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3e61e-63fc-4639-ba88-28153c7c9476 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:44.991056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3e61e-63fc-4639-ba88-28153c7c9476 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:44.991546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3e61e-63fc-4639-ba88-28153c7c9476 None admin] PATH_INFO: `/v3/projects/eda7224c979a4ec5afdb31dd26b93633` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:44.993358 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3e61e-63fc-4639-ba88-28153c7c9476 None admin] RBAC: Authorizing `identity:get_project(project_id=eda7224c979a4ec5afdb31dd26b93633)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:44.996451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3e61e-63fc-4639-ba88-28153c7c9476 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.000243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 587/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:44 2022] GET /identity/v3/projects/eda7224c979a4ec5afdb31dd26b93633 => generated 361 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:45.006408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:45.091271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:45.111832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c30f1-4c2f-46fc-b77d-4e9e0391498d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:45.150109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c43473-d204-4186-be59-2ebe4e639da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:45.150760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c43473-d204-4186-be59-2ebe4e639da3 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:45.151033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c43473-d204-4186-be59-2ebe4e639da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:45.151300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c43473-d204-4186-be59-2ebe4e639da3 None admin] PATH_INFO: `/v3/projects/eda7224c979a4ec5afdb31dd26b93633/users/b3b245681fd64111a36b6a7c137b0d9c/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:45.153202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c43473-d204-4186-be59-2ebe4e639da3 None admin] RBAC: Authorizing `identity:create_grant(project_id=eda7224c979a4ec5afdb31dd26b93633, user_id=b3b245681fd64111a36b6a7c137b0d9c, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:45.154629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c43473-d204-4186-be59-2ebe4e639da3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:45.172216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 605/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:35:45 2022] PUT /identity/v3/projects/eda7224c979a4ec5afdb31dd26b93633/users/b3b245681fd64111a36b6a7c137b0d9c/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:47.413943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b3b7-fc53-46a2-be8b-cffe7c1e15ea None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:47.414508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b3b7-fc53-46a2-be8b-cffe7c1e15ea None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:47.414508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3b3b7-fc53-46a2-be8b-cffe7c1e15ea None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:47.416027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 588/1193] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:47.422469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:47.423015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:47.423223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:47.443962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:47.445441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:47.524291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 606/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:47.798125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3b3b7-fc53-46a2-be8b-cffe7c1e15ea None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:47.891035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:47.913301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3b3b7-fc53-46a2-be8b-cffe7c1e15ea None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:47.950716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:47.951380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:47.951657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:47.951925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:47.964143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:47.969612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:47.970919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:35:47.971777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 589/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:47.977016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:48.054396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:48.086940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e6f32-64cb-4e99-88b0-ed22def55b69 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:48.123475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:48.124092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:48.124425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:48.124701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:48.125409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:48.125710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:48.127103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:48.136026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 607/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:48.143135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:48.251015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef56e0-9bac-4f80-8b46-0786aa64d35b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:48.288613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:48.289277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:48.289550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:48.289819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] PATH_INFO: `/v3/users/b3b245681fd64111a36b6a7c137b0d9c` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:48.290935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b3b245681fd64111a36b6a7c137b0d9c)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:48.292345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:48.293957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 590/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:48 2022] GET /identity/v3/users/b3b245681fd64111a36b6a7c137b0d9c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:48.300228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:48.408326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271ad07-09ab-4e3c-8153-aa91a70c28f2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:48.439635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:48.445168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:48.445790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:48.446066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:48.446336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:48.520526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:48.522003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:48.619454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 608/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:48.626098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:48.637065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:48.734339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad431a-8e77-4512-a760-f198b8b4e4b8 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:48.768833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a267e-92ec-4eb2-832d-679450190109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:48.769461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a267e-92ec-4eb2-832d-679450190109 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:48.769737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a267e-92ec-4eb2-832d-679450190109 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:48.770001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a267e-92ec-4eb2-832d-679450190109 None admin] PATH_INFO: `/v3/projects/eda7224c979a4ec5afdb31dd26b93633` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:48.771094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a267e-92ec-4eb2-832d-679450190109 None admin] RBAC: Authorizing `identity:get_project(project_id=eda7224c979a4ec5afdb31dd26b93633)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:48.772513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a267e-92ec-4eb2-832d-679450190109 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:48.774171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 591/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:48 2022] GET /identity/v3/projects/eda7224c979a4ec5afdb31dd26b93633 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:48.780327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:48.815352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:48.896397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d290f-7e91-46b0-a50d-3abe37077838 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:48.940170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:48.940841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:48.941129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:48.941461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:48.942240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=eda7224c979a4ec5afdb31dd26b93633, user.id=b3b245681fd64111a36b6a7c137b0d9c) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:48.942546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:48.944032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74e84-3d84-40a0-a776-e058adcc15e6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:48.951040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 609/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:48 2022] GET /identity/v3/role_assignments?user.id=b3b245681fd64111a36b6a7c137b0d9c&scope.project.id=eda7224c979a4ec5afdb31dd26b93633&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:58.765315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=62 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:58.948078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=52 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:49.977194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95e8f-e81e-4f04-a5f7-f2ab66073fce None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:49.977194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95e8f-e81e-4f04-a5f7-f2ab66073fce None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:49.977194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95e8f-e81e-4f04-a5f7-f2ab66073fce None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:49.978263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 592/1201] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:49.984754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:49.985672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:49.986115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.019552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:50.022177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:50.191977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 610/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:36:50.511447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95e8f-e81e-4f04-a5f7-f2ab66073fce None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.741458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95e8f-e81e-4f04-a5f7-f2ab66073fce None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.811015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.811976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.812416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.813053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.838904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.841738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:50.869011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:50.871284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:50.873459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:50.873459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:50.873459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:36:50.873459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 593/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:50.879152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:51.052588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7360-7df8-43f0-8e27-7929ff968def None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:51.117402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:51.129737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:51.130329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:51.130604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:51.130817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:51.131512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:51.132056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:51.133717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45661f49-d3b4-4b35-9e9b-62b2c4687040 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:51.150514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 611/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:51.158399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:51.260834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:51.337527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2404d-008f-41fd-8233-a818f84b87d2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:51.390438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350f76a-58ef-4703-8ca3-e628afdc3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:51.391116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350f76a-58ef-4703-8ca3-e628afdc3cc6 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:51.391400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350f76a-58ef-4703-8ca3-e628afdc3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:51.391677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350f76a-58ef-4703-8ca3-e628afdc3cc6 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:51.392536 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350f76a-58ef-4703-8ca3-e628afdc3cc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:51.394446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350f76a-58ef-4703-8ca3-e628afdc3cc6 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:51.436858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 594/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Tue Oct 4 08:36:51 2022] POST /identity/v3/users => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:36:54.480870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d49fd-5dc7-4c75-bf53-9fd2a1c3eb32 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.482259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d49fd-5dc7-4c75-bf53-9fd2a1c3eb32 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.482726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d49fd-5dc7-4c75-bf53-9fd2a1c3eb32 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.485211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 612/1206] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:36:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:54.494557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.495605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.495605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.526655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:54.529547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:54.651471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 595/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:36:54.951457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d49fd-5dc7-4c75-bf53-9fd2a1c3eb32 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.103392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d49fd-5dc7-4c75-bf53-9fd2a1c3eb32 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.177425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.178561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.179224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.179512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.196667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:36:55.202578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:55.204263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:55.205952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:36:55.208959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 613/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:55.210707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.270671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.384291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1996ac-e336-4786-877d-038af8223e93 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.457668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.458020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.458425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.458603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.459538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:55.459836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.461771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.482717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 596/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:36:55.483968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.587715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.663906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a61b7-5d71-43eb-8cba-10fc1c8bf7c0 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.719616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23587518-f930-417a-86b4-79a7d183151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.720751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23587518-f930-417a-86b4-79a7d183151f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.721323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23587518-f930-417a-86b4-79a7d183151f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.721798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23587518-f930-417a-86b4-79a7d183151f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.743438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23587518-f930-417a-86b4-79a7d183151f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.746431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23587518-f930-417a-86b4-79a7d183151f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-23587518-f930-417a-86b4-79a7d183151f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:55.767616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:55.776416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:55.777586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:55.777586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:55.777586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:36:55.777586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 614/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:55.778482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.976004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.982450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeaa640-a8d5-4d02-bcb5-0bd215720f2d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:56.063111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:56.064191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:56.064657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:56.065148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:56.066335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:56.066792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:56.069339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:56.094627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 597/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:56.104889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23587518-f930-417a-86b4-79a7d183151f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:56.269574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23587518-f930-417a-86b4-79a7d183151f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:56.272987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:56.337838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:56.338456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:56.338775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:56.339065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:56.350137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:56.351962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:36:56.366078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:56.367280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:36:56.368317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 615/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:36:56.374170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:56.528295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9e217-d784-4ed3-8746-f2f2f5f3126c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:56.588868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:56.590419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:56.590917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:56.591406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:56.592687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:56.593120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:56.595057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:56.624772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 598/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Oct 4 08:36:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:56.631223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:56.783244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161b5ce-6b0e-4041-88ab-016a1f06664f None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:56.841438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:56.842078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:56.842378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:56.842728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:56.892079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:56.948238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:56.950309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:57.083639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 616/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:36:57.091093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:57.127380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:57.280146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abcf0b-cbbd-4c24-a5cc-e26dbda1f7e9 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:57.361009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:57.362019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:57.362512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:57.362993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:57.381014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:57.383741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:57.409474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:57.416937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:57.419570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:57.419570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:57.419570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:36:57.419570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 599/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:57.419823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:57.544111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:57.632366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dccc6-897f-4bfe-9e7f-224df7b7e6ba None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:57.695401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:57.696124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:57.696295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:57.696567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:57.697269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:57.697569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:57.699635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:57.717496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 617/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:57.724588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:57.850575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:57.940353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86078301-8bc0-4cc8-9846-37b4a2b4a906 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:58.021568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:58.022257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.022493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.022790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.032803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:58.033984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:36:58.055345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:58.056373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:36:58.057351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 600/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:58.070630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:58.234162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5bc7ba-c63c-48c7-8c55-2a3831f4b236 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:58.271006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:58.287607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:58.288301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.288575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.288897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.289602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:58.289900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:58.291443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e482ed-d67d-4c96-99ee-00e1ee4fd925 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:58.309364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 618/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:58.321026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:58.508255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42fe15-8c98-454f-9691-c2808b7b4ccc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:58.558561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:58.571333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:58.572474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.573385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.573766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.575530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=c882c87fe9e04430a9c453c761e55927) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:58.576083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:58.580800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f2feb-1383-496f-8b6f-263ccd63a5e8 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:58.593414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 601/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:36:58 2022] GET /identity/v3/role_assignments?user.id=c882c87fe9e04430a9c453c761e55927&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:01.452130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571d46-6778-4a44-82ae-d23b7d64feb3 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:01.452745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571d46-6778-4a44-82ae-d23b7d64feb3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:01.452745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0571d46-6778-4a44-82ae-d23b7d64feb3 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:01.454475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 619/1220] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:01.461387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:01.461978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:01.461978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:01.483067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:01.484282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:01.574150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 602/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:01.873778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571d46-6778-4a44-82ae-d23b7d64feb3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.004338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0571d46-6778-4a44-82ae-d23b7d64feb3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.064828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.066081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.066789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.067332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.090235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:02.095833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:02.098247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:02.099932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 620/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:37:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:02.105054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.278953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550070-f592-4c6e-864e-f2b1d2493bf1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.310864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:02.326270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.326902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.327182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.327464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.328165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] RBAC: Adding query filter params (name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:02.328468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.329943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.341234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 603/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:02.347510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.422128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:02.500602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb6f0-0b4f-44f0-827b-b4502d422c7e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.552709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.552709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.552709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.552709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.570505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.573821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:02.595425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:02.602791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:02.605197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:02.605197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:02.605197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:02.605197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 621/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:02.608917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.764629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f9ed4-bb34-42d2-934f-7f67eaa4b12b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:02.806317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380debcb-b320-44d6-8227-507603f4009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:02.806808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380debcb-b320-44d6-8227-507603f4009f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.807154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380debcb-b320-44d6-8227-507603f4009f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.807485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380debcb-b320-44d6-8227-507603f4009f None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.808927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380debcb-b320-44d6-8227-507603f4009f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:02.809127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380debcb-b320-44d6-8227-507603f4009f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:02.810866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380debcb-b320-44d6-8227-507603f4009f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:02.829124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 604/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:02.837624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:02.999293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.013238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855aa442-48a0-4256-b4b7-a835cc7cafe1 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.076406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.076996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.077274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.077546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.087410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.089197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:03.113139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:03.115457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:03.117457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 622/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:03.127484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380debcb-b320-44d6-8227-507603f4009f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.186235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.270623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380debcb-b320-44d6-8227-507603f4009f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.338313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.339778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.340513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.341064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.342724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:03.343279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.346378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.372541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 605/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:03.379407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.563142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256f35-33ce-450b-bc07-1181212c5e01 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.619011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.620146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.620684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.621216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.640578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.642616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:03.667034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:03.668344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:03.674943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:03.674943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:03.674943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:03.674943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 623/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:03.675666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.856448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223395f-9fc0-4206-8a3a-d3696c88997d None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.859611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.922282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.923307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.923761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.924269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.925473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:03.925953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.928625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.954937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 606/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:03.956510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.968286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:04.113863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e429-fe97-4410-bcc5-1d803ab19687 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.181951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.183146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.183748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.184176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.193314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.194840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:04.208059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:04.209780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:04.211677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 624/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:04.219360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.372341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10047d6-be89-44aa-a188-518456f226dc None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.428255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.429106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.429446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.429875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.430792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:04.431259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.433677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7c56d-2352-44ea-a063-2db23d5d38a1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.459176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 607/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:04.460953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.557849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:04.639513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d07b6-e7e5-451f-bdfa-d2d7c9b87f5a None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.709985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003f69-736c-4d01-a10e-d9af1d74cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.711297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003f69-736c-4d01-a10e-d9af1d74cce9 None admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.711800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003f69-736c-4d01-a10e-d9af1d74cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.712305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003f69-736c-4d01-a10e-d9af1d74cce9 None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/c882c87fe9e04430a9c453c761e55927/roles/4f134265169a4eca9f2b906e1e7a16e2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.741371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0003f69-736c-4d01-a10e-d9af1d74cce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=c882c87fe9e04430a9c453c761e55927, role_id=4f134265169a4eca9f2b906e1e7a16e2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.743655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0003f69-736c-4d01-a10e-d9af1d74cce9 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.763505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 625/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:37:04 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/c882c87fe9e04430a9c453c761e55927/roles/4f134265169a4eca9f2b906e1e7a16e2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:07.118475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93bb3-4ad9-488b-b496-05fe5c4eb235 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.119284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93bb3-4ad9-488b-b496-05fe5c4eb235 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.120344 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93bb3-4ad9-488b-b496-05fe5c4eb235 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.123545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 608/1233] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:07.130312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.131429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.131429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.157082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:07.159199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:07.278964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 626/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:07.625798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c93bb3-4ad9-488b-b496-05fe5c4eb235 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:07.664128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:07.806869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c93bb3-4ad9-488b-b496-05fe5c4eb235 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:07.855949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:07.856623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.856912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.857192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.872983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:07.880081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:07.881197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:37:07.882106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:07.882758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 609/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:07.889212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:07.950707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.047700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cf964-6b2b-4dd4-88f7-7330148f1154 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.101891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.102529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.102814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.103084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.103767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] RBAC: Adding query filter params (name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:08.104121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.106074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.115710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 627/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:08.122951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.270290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.294775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8429b-8e65-427b-afec-a964cd3a488b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.347737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.348599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.349021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.349483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.367860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.369420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:08.392025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:08.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:08.400361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:08.400361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:08.400361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:08.400361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 610/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:08.403168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.578843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e254302-2caf-4e89-9976-8aa67fb12b77 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.598621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.649861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.651431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.651919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.652402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.653635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:08.654171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.658146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.678416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 628/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:08.686048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.888169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddb894-a5a7-4970-bcfd-714df6b1f591 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.936151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.937137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.937613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.938002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.943980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.953353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.955436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:08.971650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:08.974124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:08.976969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:08.982226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 611/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:08.983651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.149733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9213-afd0-450b-b4d1-95e7849b0f3d None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.226379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.227633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.228118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.228694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.230421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:09.230983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.233739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.268350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 629/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:09.278391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.439548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c36cf-7366-4d7b-9a4c-202c9b59f064 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.482330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.483153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.483619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.484137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.566954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:09.583436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.586858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.771183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 612/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:37:09.781077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.818862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:09.952811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e44ea-c7f0-4791-a3f0-82ee6735629c None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.014519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.015385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.015867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.016407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.032044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.035455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:10.057572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:10.064054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:10.067043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:10.067043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:10.067043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:10.067043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 630/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:10.067669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.220083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:10.232776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7d18e-eed9-4a93-a03e-7ca912763fd2 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.290420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.292389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.292389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.292797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.294052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:10.294536 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.296031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.310719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 613/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:10.320154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.443707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:10.482293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c245-2015-4041-8d1f-8dd1bfc84c8b None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.535820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.537054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.537546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.538120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.549775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.551837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:10.569174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:10.571078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:10.574115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 631/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:10.581411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:10.763383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a37d1d-99e9-47fc-ad4f-02f11fbe3a9e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:10.820260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:10.821046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:10.821430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:10.821797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:10.822716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:10.823301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:10.825310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb5708-ed06-4ea1-bfd2-ebe81ff6dbf4 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:10.841988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 614/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:10.849247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:11.007755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c63a5-924b-4bca-b725-f2d1ceb50cd4 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:11.057040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:11.057748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.058046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.058430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.059196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] RBAC: Adding query filter params (role.id=4f134265169a4eca9f2b906e1e7a16e2, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=c882c87fe9e04430a9c453c761e55927) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:11.059502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:11.061081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af269edd-be99-47d3-b460-2aaed285a634 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:11.068398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 632/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:37:10 2022] GET /identity/v3/role_assignments?user.id=c882c87fe9e04430a9c453c761e55927&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=4f134265169a4eca9f2b906e1e7a16e2 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:13.441207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988d68-c65a-4968-8efb-0546c7f9ab33 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:13.442036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988d68-c65a-4968-8efb-0546c7f9ab33 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:13.442036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988d68-c65a-4968-8efb-0546c7f9ab33 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:13.444051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 615/1247] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:13.451795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:13.452672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:13.452918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:13.461236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:13.485005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:13.486819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:13.606007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 633/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:13.939143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988d68-c65a-4968-8efb-0546c7f9ab33 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:13.968657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:14.110670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988d68-c65a-4968-8efb-0546c7f9ab33 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:14.171492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:14.172790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:14.173359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:14.174065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:14.191554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:14.200277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:14.201725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:14.202744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 616/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:14.211760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:14.393839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf188a-665e-4448-9bda-9a6998d2060f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:14.441334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:14.451199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:14.452168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:14.453266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:14.453266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:14.454204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:14.454715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:14.456589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:14.471393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 634/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:14.479487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:14.611371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:14.652522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355b93-e1ac-445a-8baf-8a8e330d266e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:14.716606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:14.717222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:14.717506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:14.717776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:14.732187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:14.734979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:14.764997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:14.767004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:14.769168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:14.769168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:14.769168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:14.769168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 617/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:14.778088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:14.960341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887b7e-22f1-4033-a377-8da14e2495a8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.019377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.020150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.020548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.021038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.021844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:15.022376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.024197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.043304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 635/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:15.052514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.214258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb531dc-7951-4d43-8a22-068d8108a6af None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.261532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:15.278542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.279437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.279787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.280112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.290138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.292167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:15.305752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:15.313395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:15.314602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 618/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:37:15.315346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.395927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:15.473758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385bc15-d687-4eeb-86f4-445688f55b48 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.516665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.517387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.517697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.518032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.518975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:15.519304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.521194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.548064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 636/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:15.555023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.735466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecdc21-db00-49ee-980d-f804c7b85653 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.789199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.789855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.790150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.790392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.883208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:15.905690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.907329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:16.066661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 619/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:37:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:37:16.074319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:16.218984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799df86-1e3c-4c98-9aa8-02bce3a46fc6 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:16.235805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:16.263739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:16.264393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:16.264670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:16.264980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:16.285608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:16.288329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:16.313919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:16.316078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:16.318127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:16.318127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:16.318127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:16.318127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 637/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:16.324938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:16.454658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:16.470251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190c9da-24c8-4869-aeb7-9959dfecb91e None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:16.520847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:16.521870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:16.522334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:16.522798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:16.523945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:16.524464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:16.527140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:16.547125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 620/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:16.557426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:16.730630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9ac9a-916c-4e1e-9084-44ae6dab71b8 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:16.790512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:16.791985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:16.792497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:16.792996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] PATH_INFO: `/v3/projects/service` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:16.805721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:16.809162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:16.833227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:16.834381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:16.841662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 638/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:16.844212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:16.990486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295fb70-2527-4a85-b67a-2737abf28f91 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.051932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.053014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.053465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.053942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.055474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:17.056017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.059162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f7ed8-13e7-42d9-bfe7-d3469ccf9381 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.085237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 621/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:17.092363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.140070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:17.263271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902358-82a9-49c5-8c60-2b70f84a6def None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.314927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.315560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.315837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.316177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.316919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=c882c87fe9e04430a9c453c761e55927) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:17.317229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.318747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa122-52b3-405f-933f-b538e4a628a0 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.326474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 639/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:37:17 2022] GET /identity/v3/role_assignments?user.id=c882c87fe9e04430a9c453c761e55927&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:19.705284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240f06e-e3c7-4074-8630-56a2f8c2a408 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:19.705906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240f06e-e3c7-4074-8630-56a2f8c2a408 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:19.705906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240f06e-e3c7-4074-8630-56a2f8c2a408 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:19.707150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 622/1261] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:19.713371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:19.714045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:19.714228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:19.736286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:19.737551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:19.817322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 640/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:20.101095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240f06e-e3c7-4074-8630-56a2f8c2a408 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:20.117064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:20.233638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240f06e-e3c7-4074-8630-56a2f8c2a408 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:20.279887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:20.280533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.280845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.281112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.293868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:20.299449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:20.302663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:20.304639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 623/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:20.313585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:20.334152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:20.433395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedb229-0c86-4239-9a0d-cb7c9c86b2ab None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:20.474716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:20.475603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.475881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.476154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.476862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:20.477162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:20.479238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:20.489328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 641/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:20.496093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:20.587753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:20.641611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7fb48-5ae4-4f5e-9903-b115d7541850 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:20.693912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:20.694485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.694764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.695034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.707021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:20.708505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:20.724270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:20.726147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:20.727801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:20.727801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:20.727801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:20.727801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 624/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:20.731750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:20.834619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:20.858672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96c73d-1450-4d2d-8cf9-105575e35e87 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:20.898184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:20.898874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.899153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.899421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.900141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:20.900495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:20.902048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:20.916661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 642/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:20.922795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.037612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9d18-5d20-4e3d-8cbd-f3c9bb0976a7 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:21.061745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:21.078569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:21.079219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:21.079499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:21.079768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:21.088791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:21.090354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:21.104092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:21.108394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:21.110837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 625/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:21.114108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.237208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187827fb-6f37-4b33-b33b-b272d9531808 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:21.281395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:21.282062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:21.282381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:21.282698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:21.283497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:21.283845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:21.285420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:21.295758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:21.305875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 643/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:21.317472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.489957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc106e00-819f-444c-ad98-d16f6d4bc172 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:21.536381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:21.537115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:21.537457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:21.537779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:21.552654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:21.554199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:21.575483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:21.576914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:21.578105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:21.578105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:21.578105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:21.578105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 626/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:21.586343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.710725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843665b0-fc29-495d-afdf-c0a38ba3d2d7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:21.754526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:21.755394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:21.755659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:21.755833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:21.756474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:21.756816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:21.758298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:21.772735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 644/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:21.778992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.823959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:21.949879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d4eb-1c51-43c8-8893-e2756d4433b1 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:22.014391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:22.015501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:22.016011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:22.016508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:22.029337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:22.032127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:22.057603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:22.059475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:22.061463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 627/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:22.066838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:22.144231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:22.195949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2ce43-f4b1-4f83-afed-70d81704e3b7 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:22.236191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:22.236830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:22.237107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:22.237374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:22.238069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:22.238360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:22.239815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6ad1-45de-4c6c-aca2-0c6ec146f2d4 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:22.253633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 645/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:22.260930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:22.372141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:22.382567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49695ebf-fab8-4abf-9138-a0e89003779c None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:22.420398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6390f71-5d8e-41cf-a1d5-91725db13c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:22.421095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6390f71-5d8e-41cf-a1d5-91725db13c2b None admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:22.421372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6390f71-5d8e-41cf-a1d5-91725db13c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:22.421660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6390f71-5d8e-41cf-a1d5-91725db13c2b None admin] PATH_INFO: `/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/c882c87fe9e04430a9c453c761e55927/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:22.423575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6390f71-5d8e-41cf-a1d5-91725db13c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3bf547a824c5ba023710b2a46dad5, user_id=c882c87fe9e04430a9c453c761e55927, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:22.425137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6390f71-5d8e-41cf-a1d5-91725db13c2b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:22.440693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 628/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Tue Oct 4 08:37:22 2022] PUT /identity/v3/projects/b8b3bf547a824c5ba023710b2a46dad5/users/c882c87fe9e04430a9c453c761e55927/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:24.745567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0142a-dcf1-4053-a765-ebfcdfc5203f None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:24.746220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0142a-dcf1-4053-a765-ebfcdfc5203f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:24.746220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0142a-dcf1-4053-a765-ebfcdfc5203f None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:24.747479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 646/1274] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:24.753556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:24.754414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:24.754414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:24.773895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:24.775847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:24.855675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 629/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:37:25.146508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0142a-dcf1-4053-a765-ebfcdfc5203f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:25.264139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0142a-dcf1-4053-a765-ebfcdfc5203f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:25.284816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:25.305903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:25.307312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:25.307639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:25.307916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:25.320130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:25.325724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:25.327553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:25.329279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 647/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Tue Oct 4 08:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:25.336022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:25.438143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:25.458323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be4b0e-4a1a-4881-b39f-f56521ee9b84 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:25.504391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:25.505345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:25.505712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:25.506245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:25.507305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:25.507839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:25.510350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:25.522506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 630/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Tue Oct 4 08:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:25.529200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:25.677055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6961-3a2b-46a0-8d36-d3ed1dcb3294 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:25.722943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:25.723498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:25.723801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:25.724072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:25.737232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:25.739265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:25.756803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:25.759831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:25.761903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:25.761903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:25.761903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:25.761903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 648/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:25.764773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:25.888158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c8a6a-68ee-4300-8b3c-718a030d5d9b None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:25.928956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:25.929586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:25.929869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:25.930144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:25.930799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:25.931106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:25.933386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:25.946460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 631/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:25.953511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:25.988283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:26.077654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ee048-1d25-43a3-9d4b-e4aeae53f088 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:26.126441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:26.127569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:26.128075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:26.128875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:26.141539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:26.143058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:26.156471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:26.157764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:26.159006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 649/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:26.166694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:26.171663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:26.286697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e0db8-0d4f-49b6-b771-5903579e49ce None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:26.324580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:26.325245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:26.325516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:26.325785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:26.326522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:26.326823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:26.328280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:26.350167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 632/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:26.357790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:26.513055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:26.528757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e903f-88fd-474b-93a2-24a70069de1e None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:26.568324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:26.568896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:26.569162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:26.569415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:26.647097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:26.648553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:26.749334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:26.763555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 650/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Tue Oct 4 08:37:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:37:26.769675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:26.844640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:26.887339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbdc7-d9f0-4072-a6c5-4ef48498aa82 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:26.923548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:26.924190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:26.924471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:26.924766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:26.937570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:26.939024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:26.955897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:26.957192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:26.958421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:26.958421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:26.958421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:26.960883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 633/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:26.962986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:27.074485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78da9c-1af3-4c9d-8e54-e9b5844ea452 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:27.112592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:27.113262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:27.113585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:27.113904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:27.114733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:27.115152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:27.116775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:27.132353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 651/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:27.141803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:27.251943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5e43e-04ae-47c4-8251-39b176e3b54f None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:27.266740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:27.289942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:27.291533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:27.292124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:27.292555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:27.301307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:27.302767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:27.315739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:27.317480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: ERROR keystone.server.flask.application Oct 04 08:37:27.318852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 634/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:27.323646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:27.379774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:27.435990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee580c-2afb-4d8f-8a18-16ecf8e711b2 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:27.469805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:27.470412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:27.470692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:27.470965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:27.471660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:27.471966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:27.473441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c88de8-98a1-45fb-aff9-9b038b5c2d55 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:27.487175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 652/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:27.493418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:27.611376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365befd-00fa-48fe-b070-df56db152863 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:27.647099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:27.647831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:27.648170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:27.648472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:27.649550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] RBAC: Adding query filter params (role.id=d7ef9b15eff4469b987c7ef49fc9c9ae, scope.project.id=b8b3bf547a824c5ba023710b2a46dad5, user.id=c882c87fe9e04430a9c453c761e55927) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:27.650195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:27.652754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c4548-ad51-4a49-a773-d5370080488f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:27.660314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 635/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Tue Oct 4 08:37:27 2022] GET /identity/v3/role_assignments?user.id=c882c87fe9e04430a9c453c761e55927&scope.project.id=b8b3bf547a824c5ba023710b2a46dad5&role.id=d7ef9b15eff4469b987c7ef49fc9c9ae => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:30.031910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58eb84-5449-40cc-9ed1-d484b6ff6312 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:30.032496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58eb84-5449-40cc-9ed1-d484b6ff6312 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:30.032496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58eb84-5449-40cc-9ed1-d484b6ff6312 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:30.033828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 653/1288] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:37:30.041496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:30.042298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:30.042454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:30.074390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:30.076451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:30.130315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:30.194692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 636/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:37:30.470705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58eb84-5449-40cc-9ed1-d484b6ff6312 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:30.637464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58eb84-5449-40cc-9ed1-d484b6ff6312 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:30.656555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:30.705407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:30.706849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:30.707644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:30.708535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:30.710140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:30.713301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:30.730726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:30.732177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:30.733364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 654/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:37:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:30.748294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:30.931606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6eb39-3857-4fe6-912f-28502c7b85b1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:30.992781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:30.993799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:30.994170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:30.994838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:30.995956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:30.996422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:30.998887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbc7e6-3242-425b-b862-c5f3f534b39e None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:31.008517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 637/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:31.014988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:31.145791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f126-1909-424a-a7a9-e452a8087549 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:31.190076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:31.190698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:31.190974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:31.191242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] PATH_INFO: `/v3/services` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:31.191897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] RBAC: Adding query filter params (type=placement) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:31.192199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:31.193636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5f1b-fe3e-4fcb-af6b-150a3d31eaaa None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:31.199384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 655/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:33.681679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f2257-825f-4ee8-ba9a-80416a5e9e15 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:33.682544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f2257-825f-4ee8-ba9a-80416a5e9e15 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:33.682544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f2257-825f-4ee8-ba9a-80416a5e9e15 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:33.684225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 638/1293] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:37:33.690474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663faba9-6f87-4e20-bc91-aedd3a3011ed None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:33.691086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663faba9-6f87-4e20-bc91-aedd3a3011ed None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:33.691086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663faba9-6f87-4e20-bc91-aedd3a3011ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:33.710151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-663faba9-6f87-4e20-bc91-aedd3a3011ed None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:33.711459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-663faba9-6f87-4e20-bc91-aedd3a3011ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:33.748461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:33.794977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 656/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:34.077296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f2257-825f-4ee8-ba9a-80416a5e9e15 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:34.121270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:34.236990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f2257-825f-4ee8-ba9a-80416a5e9e15 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:34.286589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c7fc9-bfca-48a3-8cd2-687a5b9cef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:34.287329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7fc9-bfca-48a3-8cd2-687a5b9cef71 None admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:34.287610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7fc9-bfca-48a3-8cd2-687a5b9cef71 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:34.287875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c7fc9-bfca-48a3-8cd2-687a5b9cef71 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:34.288563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c7fc9-bfca-48a3-8cd2-687a5b9cef71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:34.290815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c7fc9-bfca-48a3-8cd2-687a5b9cef71 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:34.308292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 639/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Tue Oct 4 08:37:34 2022] POST /identity/v3/services => generated 246 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:37:37.306368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9f879-6fc3-4a8b-9ffb-5908bdf44bba None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:37.307589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9f879-6fc3-4a8b-9ffb-5908bdf44bba None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:37.308080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9f879-6fc3-4a8b-9ffb-5908bdf44bba None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:37.309920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 657/1296] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:37.317715 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:37.318500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:37.318977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:37.351303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:37.355546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:37.485707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 640/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:37.770900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9f879-6fc3-4a8b-9ffb-5908bdf44bba None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:37.909809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9f879-6fc3-4a8b-9ffb-5908bdf44bba None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:37.955302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:37.956122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:37.956578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:37.957080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:37.958211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:37.960439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:37.972691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:37.975112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:37.977460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 658/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:37:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:37.983173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:38.003893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:38.105065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b104f-5086-43f2-9aa7-1940a9d102fa None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:38.148464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:38.149436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:38.150019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:38.150386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:38.151109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:38.151451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:38.152974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:38.159154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 641/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:37:38.166735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:38.204470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:38.287324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923a16-cdb4-40ca-bbb7-0dfb6c708974 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:38.326264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:38.326938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:38.327150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:38.327423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:38.328137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] RBAC: Adding query filter params (interface=public, service_id=275317c6a6eb4b75bfbd483f0fc07986, region_id=RegionOne) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:38.328446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:38.329877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cedb9-d00c-48ee-8100-3721bcdbd5c3 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:38.335918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 659/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Tue Oct 4 08:37:38 2022] GET /identity/v3/endpoints?service_id=275317c6a6eb4b75bfbd483f0fc07986&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:38.345853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:38.460807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:38.484254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8978-bb30-4919-9048-40e08f827429 None admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:38.523069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991b72d-0a41-4a47-8ecd-25cb5d4b497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:38.523694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991b72d-0a41-4a47-8ecd-25cb5d4b497f None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:38.523976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991b72d-0a41-4a47-8ecd-25cb5d4b497f None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:38.524822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991b72d-0a41-4a47-8ecd-25cb5d4b497f None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:38.525805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991b72d-0a41-4a47-8ecd-25cb5d4b497f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:38.527205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991b72d-0a41-4a47-8ecd-25cb5d4b497f None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:38.534880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 642/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Tue Oct 4 08:37:38 2022] GET /identity/v3/services => generated 2191 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:41.000163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de184e7-19fe-40b1-806d-5953b3b5b1be None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:41.000811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de184e7-19fe-40b1-806d-5953b3b5b1be None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:41.001007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de184e7-19fe-40b1-806d-5953b3b5b1be None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:41.002463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 660/1302] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:41.013197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:41.013760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:41.014165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:41.048191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:41.050401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:41.154049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 643/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:41.437339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de184e7-19fe-40b1-806d-5953b3b5b1be None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:41.557174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:41.565738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de184e7-19fe-40b1-806d-5953b3b5b1be None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:41.606950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:41.607597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:41.607876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:41.608147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:41.608803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:41.610220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:41.621417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:41.623244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: ERROR keystone.server.flask.application Oct 04 08:37:41.624881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 661/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Oct 4 08:37:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:37:41.629841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:41.725800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:41.759730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ef15c-a51a-49d3-867e-6731dcc4a867 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:41.803656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:41.804270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:41.804551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:41.804852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] PATH_INFO: `/v3/services` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:41.805764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:41.806631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:41.808048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdd65d-f347-4edb-ba46-09d6ee9a280c None admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:41.814619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 644/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:41.821994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:41.938377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99456c3c-ca3c-4d11-a867-7e4e3075e595 None admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:41.980068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effba3f-94b9-4325-9cdb-b0b5f531a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:41.980603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effba3f-94b9-4325-9cdb-b0b5f531a691 None admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:41.980915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effba3f-94b9-4325-9cdb-b0b5f531a691 None admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:41.981190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effba3f-94b9-4325-9cdb-b0b5f531a691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:41.981868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effba3f-94b9-4325-9cdb-b0b5f531a691 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:41.983273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effba3f-94b9-4325-9cdb-b0b5f531a691 None admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:42.007771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 662/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:51.812711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=30 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:52.002017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:55.561186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3637-24f1-4ff6-a906-666efeb933be None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:55.561924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3637-24f1-4ff6-a906-666efeb933be None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:55.562155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3637-24f1-4ff6-a906-666efeb933be None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:55.574271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05e5b-beb9-4ead-a8c9-a470f66fefa8 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:55.574980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05e5b-beb9-4ead-a8c9-a470f66fefa8 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:55.575248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb05e5b-beb9-4ead-a8c9-a470f66fefa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:55.581173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 645/1307] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:38:55 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:38:55.721911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-aeb05e5b-beb9-4ead-a8c9-a470f66fefa8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:38:55.724443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aeb05e5b-beb9-4ead-a8c9-a470f66fefa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:55.928135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 663/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:38:56.391786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a95c-f9bb-4ebf-9067-f5d63c07959a None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:56.392323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a95c-f9bb-4ebf-9067-f5d63c07959a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:56.392778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897a95c-f9bb-4ebf-9067-f5d63c07959a None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:56.394753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 646/1309] 10.222.0.45 () {54 vars in 964 bytes} [Tue Oct 4 08:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:38:56.404258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad32c-f8d4-42e0-bad2-61a34a00afe5 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:56.404546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad32c-f8d4-42e0-bad2-61a34a00afe5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:56.404858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad32c-f8d4-42e0-bad2-61a34a00afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:56.498824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cc3ad32c-f8d4-42e0-bad2-61a34a00afe5 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:38:56.500076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cc3ad32c-f8d4-42e0-bad2-61a34a00afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:56.529553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:56.636219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 664/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Tue Oct 4 08:38:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:38:56.646887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a95c-f9bb-4ebf-9067-f5d63c07959a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:38:56.648593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3897a95c-f9bb-4ebf-9067-f5d63c07959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:56.784992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897a95c-f9bb-4ebf-9067-f5d63c07959a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:38:56.889147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:38:56.890191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:38:56.890649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:38:56.891073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:38:56.893157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:38:56.962604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:38:57.043714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:38:57.046051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c36b0c-bb1f-4b09-8395-1836e116b4a7 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:38:57.080167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 647/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:00.187412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852ca6-89c6-4623-b3f1-1b8727d13301 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:00.187967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852ca6-89c6-4623-b3f1-1b8727d13301 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:00.188072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0852ca6-89c6-4623-b3f1-1b8727d13301 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:00.189403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 665/1312] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:00.195781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a787-9b72-4c90-bcf4-af8385134fe7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:00.196359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a787-9b72-4c90-bcf4-af8385134fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:00.196359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927a787-9b72-4c90-bcf4-af8385134fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:00.293415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3927a787-9b72-4c90-bcf4-af8385134fe7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:00.294672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3927a787-9b72-4c90-bcf4-af8385134fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:00.402444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 648/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:00.711940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb27d0-2938-4a44-a621-d7dd4948afb7 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:00.712221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb27d0-2938-4a44-a621-d7dd4948afb7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:00.712499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb27d0-2938-4a44-a621-d7dd4948afb7 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:00.713908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 666/1314] 10.222.0.45 () {54 vars in 964 bytes} [Tue Oct 4 08:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:39:00.720495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db660568-9761-4847-9a6c-765629f5e902 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:00.720816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db660568-9761-4847-9a6c-765629f5e902 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:00.721097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db660568-9761-4847-9a6c-765629f5e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:00.735502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:00.813684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-db660568-9761-4847-9a6c-765629f5e902 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:00.814915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-db660568-9761-4847-9a6c-765629f5e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:00.911240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 649/1315] 10.222.0.45 () {58 vars in 1061 bytes} [Tue Oct 4 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:00.920524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb27d0-2938-4a44-a621-d7dd4948afb7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:00.922175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c5cb27d0-2938-4a44-a621-d7dd4948afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:01.039231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb27d0-2938-4a44-a621-d7dd4948afb7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:01.119427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:01.122477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:01.123148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:01.123682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:01.124092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:01.125797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:01.246691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:01.248154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eeef7c-0459-426d-85de-c77360147d7e service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:01.267884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 667/1316] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:39:04.098554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47ff5b-5811-4c98-969a-eef2d280f814 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:04.098554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47ff5b-5811-4c98-969a-eef2d280f814 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:04.099351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47ff5b-5811-4c98-969a-eef2d280f814 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:04.100204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 650/1317] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:39:04.106093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d2eb-98a9-4b1e-a6dd-2e196d93e6e5 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:04.106861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d2eb-98a9-4b1e-a6dd-2e196d93e6e5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:04.107053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d2eb-98a9-4b1e-a6dd-2e196d93e6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:04.182432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ce48d2eb-98a9-4b1e-a6dd-2e196d93e6e5 None None] MFA Rules not processed for user `d56821798f4241bc8b4e31c3ac848082`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:04.183889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ce48d2eb-98a9-4b1e-a6dd-2e196d93e6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:04.236779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:04.280902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 668/1318] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:04.570780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47ff5b-5811-4c98-969a-eef2d280f814 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:04.572748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ee47ff5b-5811-4c98-969a-eef2d280f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:04.713891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47ff5b-5811-4c98-969a-eef2d280f814 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:04.716776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:04.796651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:04.797310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:04.797590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:04.797865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:04.799480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:04.912080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:04.913460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535fc21-14ad-4cba-b8f7-034e0c430645 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:04.933280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 651/1319] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:07.929214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937903-18e3-41cd-bccc-8b33aa387602 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:07.929811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937903-18e3-41cd-bccc-8b33aa387602 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:07.929811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937903-18e3-41cd-bccc-8b33aa387602 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:07.931116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 669/1320] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:39:07.937201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282918-9add-49f6-9d4e-c76e84d1e680 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:07.937700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282918-9add-49f6-9d4e-c76e84d1e680 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:07.937850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282918-9add-49f6-9d4e-c76e84d1e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:07.994457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:08.025325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6c282918-9add-49f6-9d4e-c76e84d1e680 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:08.026555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6c282918-9add-49f6-9d4e-c76e84d1e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:08.162394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 652/1321] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:08.484125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29937903-18e3-41cd-bccc-8b33aa387602 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:08.485739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-29937903-18e3-41cd-bccc-8b33aa387602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:08.608801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29937903-18e3-41cd-bccc-8b33aa387602 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:08.696865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:08.697785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:08.698186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:08.698543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:08.700402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:08.710253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:08.834701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:08.836163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49d1ef-dc1c-4a1b-bb3d-9d69947ee3a3 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:08.856895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 670/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:11.929711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0377-b202-4ae2-94c9-5c1b5872577a None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:11.930258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0377-b202-4ae2-94c9-5c1b5872577a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:11.930258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0377-b202-4ae2-94c9-5c1b5872577a None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:11.931622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 653/1323] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:11.937135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cafe-d8c6-4a63-b7cf-e829ac508741 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:11.937646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cafe-d8c6-4a63-b7cf-e829ac508741 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:11.937762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cafe-d8c6-4a63-b7cf-e829ac508741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:12.007525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-97e4cafe-d8c6-4a63-b7cf-e829ac508741 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:12.008746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-97e4cafe-d8c6-4a63-b7cf-e829ac508741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:12.066670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:12.108762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 671/1324] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:12.401353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0377-b202-4ae2-94c9-5c1b5872577a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:12.403834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-41de0377-b202-4ae2-94c9-5c1b5872577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:12.527624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0377-b202-4ae2-94c9-5c1b5872577a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:12.544685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:12.619392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:12.620368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:12.620368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:12.620572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:12.622338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:12.759711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:12.761048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87c855-53dd-4d07-aa1a-75dddfec7590 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:12.779859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 654/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:15.112574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d855e-49ce-4001-96c7-0ced69f0ca08 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:15.113159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d855e-49ce-4001-96c7-0ced69f0ca08 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:15.113254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d855e-49ce-4001-96c7-0ced69f0ca08 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:15.114562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 672/1326] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:15.123192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3b19-cdd7-47f7-bdc0-bd5753938726 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:15.123192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3b19-cdd7-47f7-bdc0-bd5753938726 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:15.123192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3b19-cdd7-47f7-bdc0-bd5753938726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:15.193026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:15.217723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-65cd3b19-cdd7-47f7-bdc0-bd5753938726 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:15.218957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-65cd3b19-cdd7-47f7-bdc0-bd5753938726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:15.327155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 655/1327] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:15.641638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d855e-49ce-4001-96c7-0ced69f0ca08 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:15.643168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e56d855e-49ce-4001-96c7-0ced69f0ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:15.764408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d855e-49ce-4001-96c7-0ced69f0ca08 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:15.851335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:15.851824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:15.852097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:15.852363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:15.854002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:15.872487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:15.967699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:15.969168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de04e-d9d8-4ca5-80c6-21978485fdce service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:15.988543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 673/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:18.313968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a561ae-f471-4b6c-8847-df19f5c7be67 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.314545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a561ae-f471-4b6c-8847-df19f5c7be67 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.314545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a561ae-f471-4b6c-8847-df19f5c7be67 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.317762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 656/1329] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:18.322482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e448-756c-44b6-8933-67bb6f7593e6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:18.323008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e448-756c-44b6-8933-67bb6f7593e6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:18.323008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87e448-756c-44b6-8933-67bb6f7593e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:18.396221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-fc87e448-756c-44b6-8933-67bb6f7593e6 None None] MFA Rules not processed for user `d56821798f4241bc8b4e31c3ac848082`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:18.397486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fc87e448-756c-44b6-8933-67bb6f7593e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:18.464858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:18.497747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 674/1330] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:18.796657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a561ae-f471-4b6c-8847-df19f5c7be67 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:18.798752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-84a561ae-f471-4b6c-8847-df19f5c7be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:18.926177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a561ae-f471-4b6c-8847-df19f5c7be67 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:18.951366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:19.018774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:19.019550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:19.019826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:19.020100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:19.021809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:19.149205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:19.150648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961035a-ac79-46e6-92a4-81bc87537770 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:19.169902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 657/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:21.588420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e17c7c-4ef9-4234-9064-1644445c7a79 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.589052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e17c7c-4ef9-4234-9064-1644445c7a79 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.589052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e17c7c-4ef9-4234-9064-1644445c7a79 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.590306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 675/1332] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:21.595895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf06d-6104-41cf-ac22-4407059b042d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:21.596583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf06d-6104-41cf-ac22-4407059b042d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:21.596583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf06d-6104-41cf-ac22-4407059b042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:21.668757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:21.671932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7e6cf06d-6104-41cf-ac22-4407059b042d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:21.674127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7e6cf06d-6104-41cf-ac22-4407059b042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:21.783906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 658/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:22.076775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e17c7c-4ef9-4234-9064-1644445c7a79 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:22.079467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-86e17c7c-4ef9-4234-9064-1644445c7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:22.203332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e17c7c-4ef9-4234-9064-1644445c7a79 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:22.291769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:22.292392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:22.292666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:22.292972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:22.294604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:22.324858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:22.410206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:22.411577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22d5a6-a209-4771-b92a-bffa8202f51b service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:22.432515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 676/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:39:24.793730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939a48-60e9-4219-854b-1c977923285a None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:24.794435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939a48-60e9-4219-854b-1c977923285a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:24.794435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939a48-60e9-4219-854b-1c977923285a None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:24.795626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 659/1335] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:24.802533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faef4c7-ffff-4749-b21e-e69b97c9ba6d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:24.803555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faef4c7-ffff-4749-b21e-e69b97c9ba6d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:24.803555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faef4c7-ffff-4749-b21e-e69b97c9ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:24.882474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9faef4c7-ffff-4749-b21e-e69b97c9ba6d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:24.883918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9faef4c7-ffff-4749-b21e-e69b97c9ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:24.972306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:24.997635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 677/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:25.286772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b939a48-60e9-4219-854b-1c977923285a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:25.288429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1b939a48-60e9-4219-854b-1c977923285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:25.399306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b939a48-60e9-4219-854b-1c977923285a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:25.429659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:25.478444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:25.479048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:25.479322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:25.479588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:25.481206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:25.599809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:25.601296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14d886-1cbd-41df-9d33-ccdf633f97af service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:25.620994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 660/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:28.341953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded98f9-c685-445d-a17d-e82863845a25 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:28.342545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded98f9-c685-445d-a17d-e82863845a25 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:28.342545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded98f9-c685-445d-a17d-e82863845a25 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:28.343873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 678/1338] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:28.350415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48909c-c21a-44d1-897a-8b6d465b8697 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:28.350960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48909c-c21a-44d1-897a-8b6d465b8697 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:28.350960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48909c-c21a-44d1-897a-8b6d465b8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:28.433584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8b48909c-c21a-44d1-897a-8b6d465b8697 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:28.435158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8b48909c-c21a-44d1-897a-8b6d465b8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:28.445041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:28.541984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 661/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:28.835776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded98f9-c685-445d-a17d-e82863845a25 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:28.837523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0ded98f9-c685-445d-a17d-e82863845a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:28.957290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded98f9-c685-445d-a17d-e82863845a25 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:29.041376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:29.041998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:29.042278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:29.042550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:29.044390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:29.091251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:29.212710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:29.214843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57186c-cd44-4176-8cc4-92ae403a63cc service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:29.236255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 679/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:33.715501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f79e-4f1a-48a5-a21b-07a1a5474ca3 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:33.716071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f79e-4f1a-48a5-a21b-07a1a5474ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:33.716071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f79e-4f1a-48a5-a21b-07a1a5474ca3 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:33.717458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 662/1341] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:33.723654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a6ee-e64d-442c-b115-b3c1cc03fe24 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:33.724098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a6ee-e64d-442c-b115-b3c1cc03fe24 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:33.724237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a6ee-e64d-442c-b115-b3c1cc03fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:33.793719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a015a6ee-e64d-442c-b115-b3c1cc03fe24 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:33.794962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a015a6ee-e64d-442c-b115-b3c1cc03fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:33.891760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:33.904036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 680/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:34.188079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753f79e-4f1a-48a5-a21b-07a1a5474ca3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:34.189811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3753f79e-4f1a-48a5-a21b-07a1a5474ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:34.300422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753f79e-4f1a-48a5-a21b-07a1a5474ca3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:34.342254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:34.387106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:34.387523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:34.387811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:34.388074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:34.389744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:34.503141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:34.504525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40351928-3958-40c8-8349-58dd038867ce service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:34.523506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 663/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:37.689007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b893b-3427-4b36-be52-6c6ae76c643b None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.689618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b893b-3427-4b36-be52-6c6ae76c643b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.689618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b893b-3427-4b36-be52-6c6ae76c643b None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.691470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 681/1344] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:37.696759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71c2dd-7265-4365-ab4e-d9255d119ede None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:37.697189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71c2dd-7265-4365-ab4e-d9255d119ede None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:37.697309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71c2dd-7265-4365-ab4e-d9255d119ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:37.765377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cc71c2dd-7265-4365-ab4e-d9255d119ede None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:37.766609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cc71c2dd-7265-4365-ab4e-d9255d119ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:37.785007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:37.869362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 664/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:38.163696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b893b-3427-4b36-be52-6c6ae76c643b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:38.165311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6a5b893b-3427-4b36-be52-6c6ae76c643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:38.296301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b893b-3427-4b36-be52-6c6ae76c643b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:38.390657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:38.391162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:38.391441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:38.391712 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:38.393968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:38.445771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:38.521290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:38.522766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f3b1e-d2b8-4161-b885-2e13efa070dd service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:38.544071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 682/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:43.311465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62564e0-94ae-4fff-9194-5a6becfda9a6 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:43.312065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62564e0-94ae-4fff-9194-5a6becfda9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:43.312065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62564e0-94ae-4fff-9194-5a6becfda9a6 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:43.313427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 665/1347] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:43.320779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf5a5f-74ab-499e-af61-547c89fbd127 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:43.321524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf5a5f-74ab-499e-af61-547c89fbd127 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:43.321524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf5a5f-74ab-499e-af61-547c89fbd127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:43.397454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4dcf5a5f-74ab-499e-af61-547c89fbd127 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:43.398690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4dcf5a5f-74ab-499e-af61-547c89fbd127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:43.504308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:43.506707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 683/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:39:43.794476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62564e0-94ae-4fff-9194-5a6becfda9a6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:39:43.796023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f62564e0-94ae-4fff-9194-5a6becfda9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:43.904939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62564e0-94ae-4fff-9194-5a6becfda9a6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:39:43.977315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:44.015815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:39:44.016432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:44.016795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:44.017064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:44.019203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:44.180605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:39:44.182279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86104-5b59-4386-ba17-465a2e0bac5d service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:39:44.205252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 666/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:39:49.432029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c2b5-3e18-4c67-bafc-1fd345815ad5 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:49.432918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c2b5-3e18-4c67-bafc-1fd345815ad5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:49.432918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c2b5-3e18-4c67-bafc-1fd345815ad5 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:49.437500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 684/1350] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:39:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:49.445197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec8fbc-d8d7-40a6-b35d-244a0ce2cc2c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:49.445197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec8fbc-d8d7-40a6-b35d-244a0ce2cc2c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:49.445197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec8fbc-d8d7-40a6-b35d-244a0ce2cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:49.558570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-1cec8fbc-d8d7-40a6-b35d-244a0ce2cc2c None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:49.561230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1cec8fbc-d8d7-40a6-b35d-244a0ce2cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:49.603983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:49.706971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 667/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:39:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:54.383076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ff1fa-1ab0-4605-aa0c-93415918e73b None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:54.383664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ff1fa-1ab0-4605-aa0c-93415918e73b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:54.384038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ff1fa-1ab0-4605-aa0c-93415918e73b None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:54.386945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 685/1352] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:39:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:54.394042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd18da0-cf52-43c2-93ea-83b1a8581a1b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:54.394816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd18da0-cf52-43c2-93ea-83b1a8581a1b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:54.394960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd18da0-cf52-43c2-93ea-83b1a8581a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:54.491459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fcd18da0-cf52-43c2-93ea-83b1a8581a1b None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:54.492735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fcd18da0-cf52-43c2-93ea-83b1a8581a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:54.598496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:54.644581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 668/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:39:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:55.992307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65929aae-2d5b-4075-b4c8-277c9b61a0cb None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:55.992884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65929aae-2d5b-4075-b4c8-277c9b61a0cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:55.992975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65929aae-2d5b-4075-b4c8-277c9b61a0cb None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:55.994243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 686/1354] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:56.000885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6883809-bc9d-47d6-9a5a-8e378308a20c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:56.002321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6883809-bc9d-47d6-9a5a-8e378308a20c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:56.002954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6883809-bc9d-47d6-9a5a-8e378308a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:56.085991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f6883809-bc9d-47d6-9a5a-8e378308a20c None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:56.087201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f6883809-bc9d-47d6-9a5a-8e378308a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:39:56.207151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 669/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:39:59.800635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58259f30-f392-4ef8-8887-921011a07de2 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:59.801211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58259f30-f392-4ef8-8887-921011a07de2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:59.801663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58259f30-f392-4ef8-8887-921011a07de2 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:59.803336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 687/1356] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:39:59.809192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f78dc-8cc7-49cf-8c41-36352b451917 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:39:59.809986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f78dc-8cc7-49cf-8c41-36352b451917 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:39:59.810397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f78dc-8cc7-49cf-8c41-36352b451917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:39:59.864016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:39:59.912741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-452f78dc-8cc7-49cf-8c41-36352b451917 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:39:59.912741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-452f78dc-8cc7-49cf-8c41-36352b451917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:00.029060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 670/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:00.348709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09498-8efa-4bc6-914c-b90c8095ec5c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.349564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09498-8efa-4bc6-914c-b90c8095ec5c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.350377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b09498-8efa-4bc6-914c-b90c8095ec5c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.353421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 688/1358] 10.222.0.45 () {54 vars in 961 bytes} [Tue Oct 4 08:40:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:00.364819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85c8c6-d5a8-42bd-9224-2dc24d58cc0e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.367111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85c8c6-d5a8-42bd-9224-2dc24d58cc0e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.367544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85c8c6-d5a8-42bd-9224-2dc24d58cc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.467621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ac85c8c6-d5a8-42bd-9224-2dc24d58cc0e None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:00.469020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ac85c8c6-d5a8-42bd-9224-2dc24d58cc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:00.542935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:00.631503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 671/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Oct 4 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:00.646273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09498-8efa-4bc6-914c-b90c8095ec5c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:00.648013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b4b09498-8efa-4bc6-914c-b90c8095ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:00.826358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b09498-8efa-4bc6-914c-b90c8095ec5c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:00.913484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:00.956857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:00.957606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:00.957980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:00.958340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:00.960037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:01.063665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:01.065644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8e43e-fe8d-411f-a6d4-0f96b49afa8c service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:01.086197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 689/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:40:03.646137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce099a9e-0c02-4844-8b48-0b3c61964315 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:03.646800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce099a9e-0c02-4844-8b48-0b3c61964315 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:03.646800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce099a9e-0c02-4844-8b48-0b3c61964315 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:03.648366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 672/1361] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:03.656961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1adc55-90f8-4112-b8f3-5f9c7bb92154 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:03.656961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1adc55-90f8-4112-b8f3-5f9c7bb92154 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:03.656961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1adc55-90f8-4112-b8f3-5f9c7bb92154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:03.772290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4d1adc55-90f8-4112-b8f3-5f9c7bb92154 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:03.775310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4d1adc55-90f8-4112-b8f3-5f9c7bb92154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:03.849963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:03.966402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 690/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:04.270313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce099a9e-0c02-4844-8b48-0b3c61964315 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:04.272249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ce099a9e-0c02-4844-8b48-0b3c61964315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:04.506927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce099a9e-0c02-4844-8b48-0b3c61964315 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:04.520236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:04.675518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:04.676294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:04.676455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:04.676669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:04.678401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:04.789102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:04.791204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7955ad1-732c-4478-89ae-592993fea6e5 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:04.810956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 673/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:07.418745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c021ea-d754-4af8-8d2e-792d9cd89437 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:07.419333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c021ea-d754-4af8-8d2e-792d9cd89437 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:07.419333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c021ea-d754-4af8-8d2e-792d9cd89437 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:07.420761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 691/1364] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:07.427568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348118-43cf-4c63-a278-76a276dd1561 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:07.428169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348118-43cf-4c63-a278-76a276dd1561 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:07.428169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348118-43cf-4c63-a278-76a276dd1561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:07.446122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:07.507371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-81348118-43cf-4c63-a278-76a276dd1561 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:07.508777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-81348118-43cf-4c63-a278-76a276dd1561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:07.628765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 674/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:07.931836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70d61-4cc2-4383-b2d0-6f0362ba30ac None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:07.932233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70d61-4cc2-4383-b2d0-6f0362ba30ac None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:07.932607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70d61-4cc2-4383-b2d0-6f0362ba30ac None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:07.934296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 692/1366] 10.222.0.45 () {54 vars in 961 bytes} [Tue Oct 4 08:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:07.940374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497831-14c2-420a-941b-e21b467e500f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:07.940660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497831-14c2-420a-941b-e21b467e500f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:07.940957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08497831-14c2-420a-941b-e21b467e500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:08.025306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-08497831-14c2-420a-941b-e21b467e500f None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:08.026537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-08497831-14c2-420a-941b-e21b467e500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:08.067062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:08.170496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 675/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Oct 4 08:40:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:08.178740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70d61-4cc2-4383-b2d0-6f0362ba30ac None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:08.180297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-17c70d61-4cc2-4383-b2d0-6f0362ba30ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:08.404665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70d61-4cc2-4383-b2d0-6f0362ba30ac None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:08.431557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:08.537058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f1ae1-cd0e-4612-9054-5e9ff51e1607 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:08.537619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f1ae1-cd0e-4612-9054-5e9ff51e1607 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:08.537619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f1ae1-cd0e-4612-9054-5e9ff51e1607 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:08.539114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 676/1368] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:08.544389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4c90-6080-4474-a79c-337ba66b254c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:08.545209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4c90-6080-4474-a79c-337ba66b254c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:08.545209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4c90-6080-4474-a79c-337ba66b254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:08.556380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:08.556985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:08.557260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:08.557530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:08.559129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:08.628588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-eb3c4c90-6080-4474-a79c-337ba66b254c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:08.629461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-eb3c4c90-6080-4474-a79c-337ba66b254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:08.672499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:08.674343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea8b05-5db7-4374-abb9-91ab5fe3ed7c service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:08.701129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 693/1369] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:08.740831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:08.748357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 677/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:09.055993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d10a5-4a29-4049-9b9a-6ad581062e02 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:09.056291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d10a5-4a29-4049-9b9a-6ad581062e02 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:09.056528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d10a5-4a29-4049-9b9a-6ad581062e02 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:09.058108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 694/1371] 10.222.0.45 () {54 vars in 963 bytes} [Tue Oct 4 08:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:09.062949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa0669-5d60-4836-92e7-eeaa50009663 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:09.063238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa0669-5d60-4836-92e7-eeaa50009663 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:09.063526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa0669-5d60-4836-92e7-eeaa50009663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:09.167570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5aaa0669-5d60-4836-92e7-eeaa50009663 None None] MFA Rules not processed for user `511d91463bbf43ef878a3111e4c11b73`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:09.169199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5aaa0669-5d60-4836-92e7-eeaa50009663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:09.256950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 678/1372] 10.222.0.45 () {58 vars in 1060 bytes} [Tue Oct 4 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:40:09.266119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d10a5-4a29-4049-9b9a-6ad581062e02 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:09.268464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-660d10a5-4a29-4049-9b9a-6ad581062e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:09.301143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:09.390363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d10a5-4a29-4049-9b9a-6ad581062e02 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:09.531105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:09.532147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:09.533807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:09.534496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:09.537519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:09.661302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:09.706109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:09.707369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee1dac-0b29-465b-8d23-f4921dfc874d service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:09.731360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 695/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:11.057224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a9d4-a514-4d30-8efc-f0c97ec25691 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:11.057811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a9d4-a514-4d30-8efc-f0c97ec25691 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:11.057811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a9d4-a514-4d30-8efc-f0c97ec25691 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:11.059123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 679/1374] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:11.064404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0813bc-f465-4e88-b694-f06cd151c82f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:11.064984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0813bc-f465-4e88-b694-f06cd151c82f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:11.064984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0813bc-f465-4e88-b694-f06cd151c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:11.138510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7f0813bc-f465-4e88-b694-f06cd151c82f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:11.139722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7f0813bc-f465-4e88-b694-f06cd151c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:11.241015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 696/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:11.548670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69a9d4-a514-4d30-8efc-f0c97ec25691 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:11.550326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9c69a9d4-a514-4d30-8efc-f0c97ec25691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:11.659673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:11.733449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69a9d4-a514-4d30-8efc-f0c97ec25691 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:11.862151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:11.862797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:11.863078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:11.863353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:11.865006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:11.920526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:11.968364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:11.970053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc83df-ed6f-46b1-a0c9-70866ac35b4b service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:11.989475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 680/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:40:14.317353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806ca13-8215-4b00-af6b-6f73fe67287a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:14.318189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806ca13-8215-4b00-af6b-6f73fe67287a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:14.318189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806ca13-8215-4b00-af6b-6f73fe67287a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:14.319534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 697/1377] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:14.325062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188d6f-8cdb-4bda-8e3f-705a62c4b49d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:14.325804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188d6f-8cdb-4bda-8e3f-705a62c4b49d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:14.325804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188d6f-8cdb-4bda-8e3f-705a62c4b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:14.399302 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7f188d6f-8cdb-4bda-8e3f-705a62c4b49d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:14.400541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7f188d6f-8cdb-4bda-8e3f-705a62c4b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:14.503902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 681/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:14.806861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806ca13-8215-4b00-af6b-6f73fe67287a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:14.808388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b806ca13-8215-4b00-af6b-6f73fe67287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:14.854409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:15.028403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806ca13-8215-4b00-af6b-6f73fe67287a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:15.201853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:15.210521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df893-947e-4591-89d6-b77695520b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:15.211135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df893-947e-4591-89d6-b77695520b90 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:15.211414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df893-947e-4591-89d6-b77695520b90 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:15.211685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df893-947e-4591-89d6-b77695520b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:15.213340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-774df893-947e-4591-89d6-b77695520b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:15.337869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774df893-947e-4591-89d6-b77695520b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:15.339679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774df893-947e-4591-89d6-b77695520b90 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:15.364410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 698/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:17.686084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcccd9-1e3d-4a00-9543-c4193b4e26d3 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:17.686084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcccd9-1e3d-4a00-9543-c4193b4e26d3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:17.686690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcccd9-1e3d-4a00-9543-c4193b4e26d3 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:17.687733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 682/1380] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:17.693453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc045af-dd20-427c-b626-7d2887acb758 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:17.693918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc045af-dd20-427c-b626-7d2887acb758 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:17.694044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc045af-dd20-427c-b626-7d2887acb758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:17.788023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ccc045af-dd20-427c-b626-7d2887acb758 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:17.790268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ccc045af-dd20-427c-b626-7d2887acb758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:17.917669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:17.956381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 699/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:18.281723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcccd9-1e3d-4a00-9543-c4193b4e26d3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:18.284440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8fbcccd9-1e3d-4a00-9543-c4193b4e26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:18.326450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:18.527210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcccd9-1e3d-4a00-9543-c4193b4e26d3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:18.656401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:18.685337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:18.686012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:18.686423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:18.686982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:18.691618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:18.818471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:18.820138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea34f0-4bc8-4181-876e-4bddeb50af5b service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:18.844914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 683/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:21.245562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d71e5-628f-488b-b3f2-e047bc1deffc None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:21.246600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d71e5-628f-488b-b3f2-e047bc1deffc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:21.246600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d71e5-628f-488b-b3f2-e047bc1deffc None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:21.247530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 700/1383] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:21.254104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921fea-9d89-4a74-8a22-68ea0aef689f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:21.254726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921fea-9d89-4a74-8a22-68ea0aef689f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:21.254726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b921fea-9d89-4a74-8a22-68ea0aef689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:21.349217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9b921fea-9d89-4a74-8a22-68ea0aef689f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:21.350725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9b921fea-9d89-4a74-8a22-68ea0aef689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:21.421896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:21.488824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 684/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:21.848750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d71e5-628f-488b-b3f2-e047bc1deffc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:21.849312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b05d71e5-628f-488b-b3f2-e047bc1deffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:22.080664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d71e5-628f-488b-b3f2-e047bc1deffc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:22.155390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:22.238218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:22.238831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:22.239106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:22.239368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:22.241041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:22.358283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:22.360049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1dc9f-b1ec-4fd1-b2fa-bda635349777 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:22.385365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 701/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:24.700774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661f70-23f9-446f-a2f2-aff5a232e145 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:24.701312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661f70-23f9-446f-a2f2-aff5a232e145 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:24.701312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661f70-23f9-446f-a2f2-aff5a232e145 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:24.702607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 685/1386] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:24.708370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e919c-b826-4a3d-88db-7f8d40b81b48 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:24.708938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e919c-b826-4a3d-88db-7f8d40b81b48 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:24.708938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e919c-b826-4a3d-88db-7f8d40b81b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:24.795438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-750e919c-b826-4a3d-88db-7f8d40b81b48 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:24.797474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-750e919c-b826-4a3d-88db-7f8d40b81b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:24.810003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:24.927128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 702/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:25.228430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62661f70-23f9-446f-a2f2-aff5a232e145 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:25.229977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-62661f70-23f9-446f-a2f2-aff5a232e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:25.389879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637d95-dbe3-46bc-b25a-8de795ac6640 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:25.390076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637d95-dbe3-46bc-b25a-8de795ac6640 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:25.390327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d637d95-dbe3-46bc-b25a-8de795ac6640 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:25.391945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 703/1388] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:25.396896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433f0de-6243-4377-a3fd-73db042a4c60 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:25.397174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433f0de-6243-4377-a3fd-73db042a4c60 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:25.397445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433f0de-6243-4377-a3fd-73db042a4c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:25.399185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62661f70-23f9-446f-a2f2-aff5a232e145 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:25.447357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:25.465239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1433f0de-6243-4377-a3fd-73db042a4c60 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:25.466461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1433f0de-6243-4377-a3fd-73db042a4c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:25.526978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:25.527591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:25.527875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:25.528228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:25.530752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:25.570188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:25.584049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 704/1389] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:40:25.634076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:25.635697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c012e-0172-433a-b65d-77e13fdab249 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:25.655113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 686/1390] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:25.900116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda49f-fc4d-4c50-829e-e97cc3afbb87 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:25.900674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda49f-fc4d-4c50-829e-e97cc3afbb87 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:25.900674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda49f-fc4d-4c50-829e-e97cc3afbb87 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:25.902049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 705/1391] 10.222.0.45 () {54 vars in 962 bytes} [Tue Oct 4 08:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:25.908143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5cf2-b4cf-4eb2-92da-bbc6457b4915 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:25.908688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5cf2-b4cf-4eb2-92da-bbc6457b4915 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:25.908688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b5cf2-b4cf-4eb2-92da-bbc6457b4915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:25.972231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:25.991583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e23b5cf2-b4cf-4eb2-92da-bbc6457b4915 None None] MFA Rules not processed for user `cc2459051d2b42ad8a9c4d51568d2c09`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:25.992837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e23b5cf2-b4cf-4eb2-92da-bbc6457b4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:26.075245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 687/1392] 10.222.0.45 () {58 vars in 1059 bytes} [Tue Oct 4 08:40:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:26.085452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdda49f-fc4d-4c50-829e-e97cc3afbb87 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:26.087281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ebdda49f-fc4d-4c50-829e-e97cc3afbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:26.201295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdda49f-fc4d-4c50-829e-e97cc3afbb87 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:26.280575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:26.281236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:26.281512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:26.281780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:26.283693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:26.331634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:26.405307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:26.406773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76a58-ae2f-4b9f-9767-537eb98d3e3b service glance] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:26.430626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 706/1393] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:27.214567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2118a8-e367-4231-828c-b4df4cdd3309 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.215158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2118a8-e367-4231-828c-b4df4cdd3309 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.215158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2118a8-e367-4231-828c-b4df4cdd3309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.293259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8c2118a8-e367-4231-828c-b4df4cdd3309 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:27.294615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8c2118a8-e367-4231-828c-b4df4cdd3309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.400468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 688/1394] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:27.446710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebf9f-e757-4a6a-9ebb-bffa5c9efa50 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.447222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebf9f-e757-4a6a-9ebb-bffa5c9efa50 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.447334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ebf9f-e757-4a6a-9ebb-bffa5c9efa50 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.448586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 707/1395] 10.222.0.45 () {54 vars in 943 bytes} [Tue Oct 4 08:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:27.455105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94598b4-83ad-4cae-83ad-c20005cd5be5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.455391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94598b4-83ad-4cae-83ad-c20005cd5be5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.455665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94598b4-83ad-4cae-83ad-c20005cd5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.468947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:27.565125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c94598b4-83ad-4cae-83ad-c20005cd5be5 None None] MFA Rules not processed for user `763cd7c148d24a679cc2a51a4edfcfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:27.566405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c94598b4-83ad-4cae-83ad-c20005cd5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.689078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 689/1396] 10.222.0.45 () {58 vars in 1040 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:27.698674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ebf9f-e757-4a6a-9ebb-bffa5c9efa50 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:27.700203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8a8ebf9f-e757-4a6a-9ebb-bffa5c9efa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:27.871368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ebf9f-e757-4a6a-9ebb-bffa5c9efa50 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:27.890279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:27.929311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1998-2bd9-4085-ac80-6dd1defa4b3b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.929833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1998-2bd9-4085-ac80-6dd1defa4b3b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.930008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e1998-2bd9-4085-ac80-6dd1defa4b3b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.931455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 690/1397] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:27.939561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19f0b-310b-44f1-8239-3a6db69914db None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:27.939790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19f0b-310b-44f1-8239-3a6db69914db None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:27.940283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e19f0b-310b-44f1-8239-3a6db69914db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:27.999197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:28.000281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:28.000783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:28.001080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:28.002978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:28.022161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-61e19f0b-310b-44f1-8239-3a6db69914db None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:28.023381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-61e19f0b-310b-44f1-8239-3a6db69914db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:28.049635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:28.111320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:28.114466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:28.130644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 708/1398] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:40:28.170520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 691/1399] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:40:28.469620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:28.470965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:28.524928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:28.581813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef7605-6579-4eb4-a819-ac40980c9d48 service swift] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:28.736346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:28.737021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:28.737362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:28.737692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:28.739388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:28.821066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:28.852859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:28.854495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3be19-5ce1-4c18-b7eb-2775bb9bb995 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:28.874264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 709/1400] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:31.177694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a385-4429-410e-a4eb-617eb650aad6 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.178286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a385-4429-410e-a4eb-617eb650aad6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.178286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3a385-4429-410e-a4eb-617eb650aad6 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.179872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 692/1401] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:31.185280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d825ce-3dad-4708-a8e8-4f1c71db26af None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:31.185770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d825ce-3dad-4708-a8e8-4f1c71db26af None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:31.185945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d825ce-3dad-4708-a8e8-4f1c71db26af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:31.301020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-41d825ce-3dad-4708-a8e8-4f1c71db26af None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:31.302675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-41d825ce-3dad-4708-a8e8-4f1c71db26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:31.556936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 710/1402] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:31.861758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3a385-4429-410e-a4eb-617eb650aad6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:31.863146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-81a3a385-4429-410e-a4eb-617eb650aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:32.059442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:32.062579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3a385-4429-410e-a4eb-617eb650aad6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:32.256047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:32.257509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:32.257988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:32.258486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:32.260428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:32.416606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:32.419340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bf11-c40a-4fb4-beb9-78749333f2cf service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:32.446602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 693/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:34.794057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e6226-fda5-4956-aa0d-ed283e372f2c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:34.794680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e6226-fda5-4956-aa0d-ed283e372f2c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:34.794680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e6226-fda5-4956-aa0d-ed283e372f2c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:34.800987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 711/1404] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:34.803529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7411-d064-49c9-aac7-97d427176976 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:34.804018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7411-d064-49c9-aac7-97d427176976 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:34.804105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a7411-d064-49c9-aac7-97d427176976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:34.810392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:34.887172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a99a7411-d064-49c9-aac7-97d427176976 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:34.887172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a99a7411-d064-49c9-aac7-97d427176976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:35.024164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 694/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:35.327922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e6226-fda5-4956-aa0d-ed283e372f2c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:35.330286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e87e6226-fda5-4956-aa0d-ed283e372f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:35.386796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:35.517472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e6226-fda5-4956-aa0d-ed283e372f2c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:35.659292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:35.660267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:35.660772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:35.661258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:35.664859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:35.667902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:35.793982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:35.795644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c7ffe-c75b-48a1-9ff7-f53222b3ee32 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:35.824326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 712/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:38.340612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e8be-5097-4a34-ba6b-6e43dcf56d41 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:38.341249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e8be-5097-4a34-ba6b-6e43dcf56d41 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:38.341249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e8be-5097-4a34-ba6b-6e43dcf56d41 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:38.348587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 695/1407] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:40:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:40:38.350203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6af1a-9faf-496c-a0ae-4ac7ba0ae480 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:38.350689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6af1a-9faf-496c-a0ae-4ac7ba0ae480 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:38.350889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6af1a-9faf-496c-a0ae-4ac7ba0ae480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:38.492199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a5c6af1a-9faf-496c-a0ae-4ac7ba0ae480 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:38.493901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a5c6af1a-9faf-496c-a0ae-4ac7ba0ae480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:38.621574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:38.665130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 713/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:39.012367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114e8be-5097-4a34-ba6b-6e43dcf56d41 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:39.013965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1114e8be-5097-4a34-ba6b-6e43dcf56d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:39.121220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:39.212098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114e8be-5097-4a34-ba6b-6e43dcf56d41 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:39.386434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:39.387086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:39.387431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:39.387774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:39.389482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:39.445240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:39.502083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:39.503980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57ccf0-86ac-4d26-a610-db676b43d903 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:39.524589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 696/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:48.663139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=9 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:49.522332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=25 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:51.750758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eca57-4190-43f5-b4a4-ea1d25b7fec9 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:51.751377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eca57-4190-43f5-b4a4-ea1d25b7fec9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:51.751377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eca57-4190-43f5-b4a4-ea1d25b7fec9 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:51.752732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 714/1410] 10.222.0.45 () {54 vars in 918 bytes} [Tue Oct 4 08:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:51.757822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971514-2b95-43bb-9e38-c20245e6e16b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:51.758246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971514-2b95-43bb-9e38-c20245e6e16b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:51.758366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971514-2b95-43bb-9e38-c20245e6e16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:51.835337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-64971514-2b95-43bb-9e38-c20245e6e16b None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:51.836573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-64971514-2b95-43bb-9e38-c20245e6e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:51.947326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 697/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 4 08:40:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:51.961410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b98b7-8afc-4015-b2d1-cc4ca0d014ce None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:51.961719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b98b7-8afc-4015-b2d1-cc4ca0d014ce None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:51.962015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b98b7-8afc-4015-b2d1-cc4ca0d014ce None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:51.963316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 715/1412] 10.222.0.45 () {54 vars in 918 bytes} [Tue Oct 4 08:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:51.967931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295962d-fc39-4eb8-bfee-fc799e47729d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:51.968221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295962d-fc39-4eb8-bfee-fc799e47729d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:51.968501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295962d-fc39-4eb8-bfee-fc799e47729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:52.041544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:52.044158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a295962d-fc39-4eb8-bfee-fc799e47729d None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:52.045955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a295962d-fc39-4eb8-bfee-fc799e47729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:52.284807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 698/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 4 08:40:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:54.871080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faab4f-0fb5-4d77-bfc9-cc563228c78a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:54.871645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faab4f-0fb5-4d77-bfc9-cc563228c78a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:54.871645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faab4f-0fb5-4d77-bfc9-cc563228c78a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:54.873076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:54.878991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402a75a-d58f-424e-bb8e-d5feccb9c9fb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:54.879552 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402a75a-d58f-424e-bb8e-d5feccb9c9fb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:54.879707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402a75a-d58f-424e-bb8e-d5feccb9c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:54.949972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0402a75a-d58f-424e-bb8e-d5feccb9c9fb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:54.951200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0402a75a-d58f-424e-bb8e-d5feccb9c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:55.007423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:55.051340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:55.339540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faab4f-0fb5-4d77-bfc9-cc563228c78a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:55.341109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-67faab4f-0fb5-4d77-bfc9-cc563228c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:55.485108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faab4f-0fb5-4d77-bfc9-cc563228c78a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:55.558248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:55.718606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:55.719211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:55.719523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:55.719857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:55.721509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:55.810978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:55.812473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d6e2e-d41d-43f2-b091-15582e0de5ea service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:55.831157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 717/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:57.024284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d9fc7-3427-4b18-9a96-03f617de0821 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.024890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d9fc7-3427-4b18-9a96-03f617de0821 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.024890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d9fc7-3427-4b18-9a96-03f617de0821 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.026251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:57.033427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d189cc-da70-4f15-b108-b9e5e077d0f6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.033916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d189cc-da70-4f15-b108-b9e5e077d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.034019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d189cc-da70-4f15-b108-b9e5e077d0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.111332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-14d189cc-da70-4f15-b108-b9e5e077d0f6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:57.112523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14d189cc-da70-4f15-b108-b9e5e077d0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.142587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:57.213005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:57.365194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d9fc7-3427-4b18-9a96-03f617de0821 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:57.366625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a57d9fc7-3427-4b18-9a96-03f617de0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.511331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d9fc7-3427-4b18-9a96-03f617de0821 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:57.551731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:57.627590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:57.628131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:57.628406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:57.628677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:57.630300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:57.720142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:57.721810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8d3f8-3969-4e7f-864d-ccbd629b7618 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:57.741779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 701/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:40:58.902300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4f9cb-9488-44e8-8ac8-27c4c1b1f3cb None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:58.902909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4f9cb-9488-44e8-8ac8-27c4c1b1f3cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:58.902909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4f9cb-9488-44e8-8ac8-27c4c1b1f3cb None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:58.904184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:40:58.910870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb929c9-ebff-41bb-8c9e-f45b8ba2e788 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:58.911292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb929c9-ebff-41bb-8c9e-f45b8ba2e788 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:58.911407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb929c9-ebff-41bb-8c9e-f45b8ba2e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:58.965438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:58.988635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-abb929c9-ebff-41bb-8c9e-f45b8ba2e788 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:40:58.989889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-abb929c9-ebff-41bb-8c9e-f45b8ba2e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:59.086021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:40:59.240128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4f9cb-9488-44e8-8ac8-27c4c1b1f3cb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:40:59.241627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e3a4f9cb-9488-44e8-8ac8-27c4c1b1f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:59.387468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4f9cb-9488-44e8-8ac8-27c4c1b1f3cb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:40:59.399518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:40:59.500954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:40:59.501452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:40:59.501731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:40:59.501999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:40:59.503606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:40:59.593842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:40:59.596359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499cd3d-73e3-42f4-8c57-d693627505fd service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:40:59.614472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 720/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:00.746002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a682418-3015-4234-a593-eebdb3bb8abf None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:00.746591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a682418-3015-4234-a593-eebdb3bb8abf None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:00.746591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a682418-3015-4234-a593-eebdb3bb8abf None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:00.747933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:00.755019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1a55-03e7-4203-ae31-f6efefdba748 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:00.755473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1a55-03e7-4203-ae31-f6efefdba748 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:00.755567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1a55-03e7-4203-ae31-f6efefdba748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:00.784777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:00.841706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-29dc1a55-03e7-4203-ae31-f6efefdba748 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:00.842921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-29dc1a55-03e7-4203-ae31-f6efefdba748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:00.941769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:01.090644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a682418-3015-4234-a593-eebdb3bb8abf None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:01.092190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5a682418-3015-4234-a593-eebdb3bb8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.206822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:01.242546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a682418-3015-4234-a593-eebdb3bb8abf None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:01.363252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:01.363763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:01.364034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:01.364298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:01.365898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:01.439140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:01.452240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:01.453869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2282d-440b-45a8-a57d-495f0498cc37 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:01.471765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 704/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:02.606215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d8d18-e090-4062-b938-cd826f2ecf26 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.606878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d8d18-e090-4062-b938-cd826f2ecf26 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.606878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d8d18-e090-4062-b938-cd826f2ecf26 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.608072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:41:02.614740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2fe6-1aac-42b5-8e54-0d0816aecc1a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:02.615199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2fe6-1aac-42b5-8e54-0d0816aecc1a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:02.615297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2fe6-1aac-42b5-8e54-0d0816aecc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:02.690603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2f5b2fe6-1aac-42b5-8e54-0d0816aecc1a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:02.691783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2f5b2fe6-1aac-42b5-8e54-0d0816aecc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:02.787562 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:02.935597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d8d18-e090-4062-b938-cd826f2ecf26 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:02.937156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-df5d8d18-e090-4062-b938-cd826f2ecf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:03.027735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:03.090137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d8d18-e090-4062-b938-cd826f2ecf26 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:03.205153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:03.205717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:03.205996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:03.206265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:03.207873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:03.257345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:03.298801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:03.300399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58384a6-90a7-4851-ae6d-7fd983a2d773 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:03.320635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 723/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:04.415666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7c5e-00b0-49dc-bcc3-82714630c598 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.416244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7c5e-00b0-49dc-bcc3-82714630c598 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.416244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7c5e-00b0-49dc-bcc3-82714630c598 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.417666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:04.424281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fbd1-89a4-4857-b67b-6b79ac3121ea None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:04.424782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fbd1-89a4-4857-b67b-6b79ac3121ea None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:04.424915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829fbd1-89a4-4857-b67b-6b79ac3121ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:04.501134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e829fbd1-89a4-4857-b67b-6b79ac3121ea None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:04.502327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e829fbd1-89a4-4857-b67b-6b79ac3121ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:04.599931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:04.748859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7c5e-00b0-49dc-bcc3-82714630c598 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:04.750275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f7cf7c5e-00b0-49dc-bcc3-82714630c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:04.799405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:04.896346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7c5e-00b0-49dc-bcc3-82714630c598 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:05.013508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:05.014027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:05.014310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:05.014579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:05.016206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:05.023232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:05.112492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:05.114216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1b9e8-1f2c-4ab7-a4f8-3e5d0db8cac1 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:05.137408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 707/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:06.212096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d1d59-f239-4ded-b9c7-33f6a948dd40 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:06.212636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d1d59-f239-4ded-b9c7-33f6a948dd40 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:06.212636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d1d59-f239-4ded-b9c7-33f6a948dd40 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:06.213980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:06.220273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ad554-e1ba-4f77-8a70-a0c2f03cdfae None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:06.220784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ad554-e1ba-4f77-8a70-a0c2f03cdfae None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:06.220905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ad554-e1ba-4f77-8a70-a0c2f03cdfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:06.296797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cd6ad554-e1ba-4f77-8a70-a0c2f03cdfae None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:06.298572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cd6ad554-e1ba-4f77-8a70-a0c2f03cdfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:06.367397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:06.397087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:06.549415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d1d59-f239-4ded-b9c7-33f6a948dd40 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:06.550942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-672d1d59-f239-4ded-b9c7-33f6a948dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:06.568650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:06.701242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d1d59-f239-4ded-b9c7-33f6a948dd40 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:06.787507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:06.814050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:06.814558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:06.814830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:06.815092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:06.816667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:06.905976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:06.908210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4cd8a-1c25-48db-9108-fffab133d7f2 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:06.926586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 726/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:07.992697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5a79-a38a-40d3-af43-3d9da3ed1864 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:07.993209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5a79-a38a-40d3-af43-3d9da3ed1864 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:07.993304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5a79-a38a-40d3-af43-3d9da3ed1864 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:07.994645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:08.001379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5fa8-f89b-439f-bcb5-1a4c0560aaee None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.001816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5fa8-f89b-439f-bcb5-1a4c0560aaee None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.001918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5fa8-f89b-439f-bcb5-1a4c0560aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.081403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a73c5fa8-f89b-439f-bcb5-1a4c0560aaee None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:08.082641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a73c5fa8-f89b-439f-bcb5-1a4c0560aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.134863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:08.193819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:08.341647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5a79-a38a-40d3-af43-3d9da3ed1864 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:08.343171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-59de5a79-a38a-40d3-af43-3d9da3ed1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.489321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5a79-a38a-40d3-af43-3d9da3ed1864 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:08.542939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:08.603644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:08.604164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:08.604439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:08.604710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:08.606720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:08.694719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:08.696295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564e5b0-4f7d-4e5e-9701-5520f227977d service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:08.714161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 710/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:09.774781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426952b-5fe5-4b6e-a753-09f98ef617f2 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:09.775365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426952b-5fe5-4b6e-a753-09f98ef617f2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:09.775365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426952b-5fe5-4b6e-a753-09f98ef617f2 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:09.776640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:09.783897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f2428-dccd-4358-8796-011265c79c2f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:09.784348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f2428-dccd-4358-8796-011265c79c2f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:09.784453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f2428-dccd-4358-8796-011265c79c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:09.862719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6f3f2428-dccd-4358-8796-011265c79c2f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:09.863943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6f3f2428-dccd-4358-8796-011265c79c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:09.866075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:09.961898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:10.117969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426952b-5fe5-4b6e-a753-09f98ef617f2 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:10.119533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9426952b-5fe5-4b6e-a753-09f98ef617f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:10.269535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426952b-5fe5-4b6e-a753-09f98ef617f2 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:10.297049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:10.383150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:10.383667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:10.383946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:10.384219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:10.385867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:10.476533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:10.478178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3cea6-8339-4139-936b-69e7da530660 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:10.495731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 729/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:41:12.618846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4f06-9c5f-42b3-8dff-36bd58fc7b99 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:12.619419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4f06-9c5f-42b3-8dff-36bd58fc7b99 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:12.619419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b4f06-9c5f-42b3-8dff-36bd58fc7b99 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:12.620766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:12.626283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740eaec-7f7a-4677-8297-00eb900a0eaf None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:12.626732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740eaec-7f7a-4677-8297-00eb900a0eaf None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:12.626834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740eaec-7f7a-4677-8297-00eb900a0eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:12.668624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:12.695711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a740eaec-7f7a-4677-8297-00eb900a0eaf None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:12.696942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a740eaec-7f7a-4677-8297-00eb900a0eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:12.794509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:13.087251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b4f06-9c5f-42b3-8dff-36bd58fc7b99 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:13.088804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bf2b4f06-9c5f-42b3-8dff-36bd58fc7b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:13.198434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b4f06-9c5f-42b3-8dff-36bd58fc7b99 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:13.231117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:13.274348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:13.274954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:13.275228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:13.275494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:13.277142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:13.402062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:13.403395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e52ffc-ead2-43dc-85e4-1b2b989588bc service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:13.421548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 713/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:15.776445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8a2c-b886-4091-a6da-0cff14a1c06a None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:15.777060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8a2c-b886-4091-a6da-0cff14a1c06a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:15.777060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8a2c-b886-4091-a6da-0cff14a1c06a None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:15.778351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:15.784595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50274cd-4fb3-4d4e-9ea3-8f66ec392491 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:15.785058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50274cd-4fb3-4d4e-9ea3-8f66ec392491 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:15.785177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50274cd-4fb3-4d4e-9ea3-8f66ec392491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:15.852315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f50274cd-4fb3-4d4e-9ea3-8f66ec392491 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:15.853556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f50274cd-4fb3-4d4e-9ea3-8f66ec392491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:15.866976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:15.950865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:16.238458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8a2c-b886-4091-a6da-0cff14a1c06a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:16.241197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b8ef8a2c-b886-4091-a6da-0cff14a1c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:16.346038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8a2c-b886-4091-a6da-0cff14a1c06a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:16.359096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:16.420911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:16.421425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:16.421703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:16.422014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:16.423724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:16.532098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:16.533573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ccd7e-45b6-4f13-ad36-c30179c35594 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:16.550942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 732/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:19.133271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76275181-2cae-4479-b018-c0fcaee88f48 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:19.133835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76275181-2cae-4479-b018-c0fcaee88f48 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:19.133835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76275181-2cae-4479-b018-c0fcaee88f48 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:19.135153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:41:19.141309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485111a3-405f-48e8-9067-c5645ebdf8d2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:19.141965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485111a3-405f-48e8-9067-c5645ebdf8d2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:19.142063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485111a3-405f-48e8-9067-c5645ebdf8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:19.195738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:19.214322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-485111a3-405f-48e8-9067-c5645ebdf8d2 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:19.215541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-485111a3-405f-48e8-9067-c5645ebdf8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:19.315143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:19.615211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76275181-2cae-4479-b018-c0fcaee88f48 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:19.616782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-76275181-2cae-4479-b018-c0fcaee88f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:19.721429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76275181-2cae-4479-b018-c0fcaee88f48 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:19.762924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:19.796300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:19.797506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:19.797774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:19.798048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:19.799669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:19.916743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:19.918398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e80ed-0c54-49de-a22c-db5a7d41bcc9 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:19.937151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 716/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:22.245976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f0fb-5af1-45c2-b05c-1231c3989b7f None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:22.246535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f0fb-5af1-45c2-b05c-1231c3989b7f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:22.246535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f0fb-5af1-45c2-b05c-1231c3989b7f None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:22.247837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:22.253853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b837ba-603f-4327-91e5-b5d3d7c73dfb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:22.254289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b837ba-603f-4327-91e5-b5d3d7c73dfb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:22.254408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b837ba-603f-4327-91e5-b5d3d7c73dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:22.321748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c0b837ba-603f-4327-91e5-b5d3d7c73dfb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:22.322964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c0b837ba-603f-4327-91e5-b5d3d7c73dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:22.344742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:22.421259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:22.711661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f0fb-5af1-45c2-b05c-1231c3989b7f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:22.713246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dc37f0fb-5af1-45c2-b05c-1231c3989b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:22.820572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f0fb-5af1-45c2-b05c-1231c3989b7f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:22.840859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:22.895354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:22.895954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:22.896238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:22.896509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:22.898142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:23.007627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:23.009013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f717a35-be33-444b-9b0d-bd3a3b0e9602 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:23.027243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 735/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:25.342034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052f78f-3434-4ddf-b034-c5433fe1f065 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:25.342598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052f78f-3434-4ddf-b034-c5433fe1f065 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:25.342598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052f78f-3434-4ddf-b034-c5433fe1f065 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:25.343985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:25.349688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637eef-dd8d-4f1e-a5b9-5dc1011425fd None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:25.350119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637eef-dd8d-4f1e-a5b9-5dc1011425fd None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:25.350236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637eef-dd8d-4f1e-a5b9-5dc1011425fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:25.414531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:25.417053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-85637eef-dd8d-4f1e-a5b9-5dc1011425fd None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:25.418945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-85637eef-dd8d-4f1e-a5b9-5dc1011425fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:25.515189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:25.803645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052f78f-3434-4ddf-b034-c5433fe1f065 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:25.805216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7052f78f-3434-4ddf-b034-c5433fe1f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:25.907904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052f78f-3434-4ddf-b034-c5433fe1f065 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:25.958798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:25.983939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:25.985123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:25.985545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:25.985814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:25.987383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:26.097429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:26.099046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83753767-b163-4f53-bcef-620890f94b58 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:26.118873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 719/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:28.375909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8d96-430d-4ae9-9c18-7705cc679cca None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:28.376448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8d96-430d-4ae9-9c18-7705cc679cca None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:28.376448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e8d96-430d-4ae9-9c18-7705cc679cca None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:28.377880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:28.383468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c81d-0481-45a5-ad40-e3fc7fad2a66 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:28.383877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c81d-0481-45a5-ad40-e3fc7fad2a66 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:28.384012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c81d-0481-45a5-ad40-e3fc7fad2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:28.449995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-db41c81d-0481-45a5-ad40-e3fc7fad2a66 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:28.451210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-db41c81d-0481-45a5-ad40-e3fc7fad2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:28.480554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:28.548338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:28.831174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8d96-430d-4ae9-9c18-7705cc679cca None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:28.832741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-304e8d96-430d-4ae9-9c18-7705cc679cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:28.938873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e8d96-430d-4ae9-9c18-7705cc679cca None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:28.967380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:29.013477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:29.014084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:29.014366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:29.014638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:29.017014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:29.127120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:29.128579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69ce1d-7961-476a-9af3-9eadb7744415 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:29.147355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 738/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:31.371553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3383fd-b587-4069-838a-a27f2e56470a None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:31.372068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3383fd-b587-4069-838a-a27f2e56470a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:31.372068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3383fd-b587-4069-838a-a27f2e56470a None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:31.373396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:31.378756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09858c44-9f0b-4155-9b9c-7d7ffd9c85ad None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:31.379204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09858c44-9f0b-4155-9b9c-7d7ffd9c85ad None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:31.379336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09858c44-9f0b-4155-9b9c-7d7ffd9c85ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:31.444658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-09858c44-9f0b-4155-9b9c-7d7ffd9c85ad None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:31.445902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-09858c44-9f0b-4155-9b9c-7d7ffd9c85ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:31.454377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:31.543592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:31.830759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3383fd-b587-4069-838a-a27f2e56470a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:31.832380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0f3383fd-b587-4069-838a-a27f2e56470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:31.938179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3383fd-b587-4069-838a-a27f2e56470a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:31.993839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:32.012704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:32.013341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:32.013625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:32.013902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:32.015555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:32.133628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:32.135097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cb4a-9548-4a4d-a3f6-fcb8063cc198 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:32.152791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 722/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:34.472493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ada3f1-e8b9-4f2a-aa68-3e9a52d6bb97 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:34.473524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ada3f1-e8b9-4f2a-aa68-3e9a52d6bb97 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:34.473524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ada3f1-e8b9-4f2a-aa68-3e9a52d6bb97 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:34.474724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:34.479946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8a38-c3ff-452e-bb80-75b4347af68f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:34.480407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8a38-c3ff-452e-bb80-75b4347af68f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:34.480518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8a38-c3ff-452e-bb80-75b4347af68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:34.548173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b00f8a38-c3ff-452e-bb80-75b4347af68f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:34.549409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b00f8a38-c3ff-452e-bb80-75b4347af68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:34.587028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:34.646672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:34.939223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ada3f1-e8b9-4f2a-aa68-3e9a52d6bb97 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:34.940904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a2ada3f1-e8b9-4f2a-aa68-3e9a52d6bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:35.051955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ada3f1-e8b9-4f2a-aa68-3e9a52d6bb97 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:35.103059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:35.144667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:35.145297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:35.145570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:35.145833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:35.147481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:35.269929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:35.271386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c7a23-b47c-47a3-a42d-99a198f135c4 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:35.289337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 741/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:37.529390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9db14-a96a-4d35-a9de-6f6283d6f65d None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:37.529945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9db14-a96a-4d35-a9de-6f6283d6f65d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:37.529945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9db14-a96a-4d35-a9de-6f6283d6f65d None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:37.531487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:37.537121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4332d-2082-48e9-bea7-b07ba154d717 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:37.537518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4332d-2082-48e9-bea7-b07ba154d717 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:37.537679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4332d-2082-48e9-bea7-b07ba154d717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:37.604613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-d5f4332d-2082-48e9-bea7-b07ba154d717 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:37.605862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d5f4332d-2082-48e9-bea7-b07ba154d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:37.623733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:37.703692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:37.994402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9db14-a96a-4d35-a9de-6f6283d6f65d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:37.996321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4dc9db14-a96a-4d35-a9de-6f6283d6f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:38.100808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9db14-a96a-4d35-a9de-6f6283d6f65d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:38.171263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:38.178273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:38.178877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:38.179154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:38.179418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:38.181718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:38.290834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:38.292262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0533abd-b6fb-472f-b54f-78aee5854751 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:38.311352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 725/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:41:40.598678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1006-0c9f-4192-906d-314c5a8a29df None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:40.599226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1006-0c9f-4192-906d-314c5a8a29df None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:40.599226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1006-0c9f-4192-906d-314c5a8a29df None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:40.600561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:41:40.606026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d6b-9e0e-404b-b4aa-cc54b83f5023 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:40.606498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d6b-9e0e-404b-b4aa-cc54b83f5023 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:40.606614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c332d6b-9e0e-404b-b4aa-cc54b83f5023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:40.674334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-1c332d6b-9e0e-404b-b4aa-cc54b83f5023 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:41:40.675541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1c332d6b-9e0e-404b-b4aa-cc54b83f5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:40.723907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:40.772852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:41:41.059144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a1006-0c9f-4192-906d-314c5a8a29df None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:41:41.060776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c18a1006-0c9f-4192-906d-314c5a8a29df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:41.170199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a1006-0c9f-4192-906d-314c5a8a29df None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:41:41.220306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:41.246339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:41:41.246947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:41.247230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:41.247502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:41.249141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:41:41.358194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:41:41.359588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55c175-068b-4dc2-9645-54f4de43c9a0 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:41:41.377885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 744/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:41:50.771352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=22 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:41:51.375663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=66 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:01.657567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16cc3-4322-4a1f-8e98-2d0d27f0c20b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:01.658162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16cc3-4322-4a1f-8e98-2d0d27f0c20b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:01.658162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16cc3-4322-4a1f-8e98-2d0d27f0c20b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:01.659477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 727/1471] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:01.664707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6babf-c2d1-4b7c-9441-6841b2a8dd03 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:01.665141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6babf-c2d1-4b7c-9441-6841b2a8dd03 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:01.665310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6babf-c2d1-4b7c-9441-6841b2a8dd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:01.732923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-20d6babf-c2d1-4b7c-9441-6841b2a8dd03 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:01.734679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-20d6babf-c2d1-4b7c-9441-6841b2a8dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:01.831283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 745/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:02.135923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953900bf-e8b4-4554-bf6d-eb7b0245b887 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:02.136259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953900bf-e8b4-4554-bf6d-eb7b0245b887 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:02.136537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953900bf-e8b4-4554-bf6d-eb7b0245b887 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:02.137952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 728/1473] 10.222.0.45 () {54 vars in 962 bytes} [Tue Oct 4 08:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:02.143155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cadff8-ddc3-4837-be31-35f2c6777725 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:02.143441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cadff8-ddc3-4837-be31-35f2c6777725 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:02.143722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cadff8-ddc3-4837-be31-35f2c6777725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:02.220251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-13cadff8-ddc3-4837-be31-35f2c6777725 None None] MFA Rules not processed for user `cc2459051d2b42ad8a9c4d51568d2c09`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:02.221505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-13cadff8-ddc3-4837-be31-35f2c6777725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:02.243340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:02.299882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 746/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Tue Oct 4 08:42:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:02.307614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953900bf-e8b4-4554-bf6d-eb7b0245b887 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:02.309162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-953900bf-e8b4-4554-bf6d-eb7b0245b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:02.412200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953900bf-e8b4-4554-bf6d-eb7b0245b887 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:02.485608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:02.486211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:02.486510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:02.486813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:02.488361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:02.542791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:02.599532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:02.601006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1149cc-5f1b-438e-a19f-8879e0b7cfd1 service glance] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:02.619522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 729/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:04.879010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627f9e-3859-4b7c-aa7c-2b71968e6052 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:04.879660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627f9e-3859-4b7c-aa7c-2b71968e6052 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:04.879660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627f9e-3859-4b7c-aa7c-2b71968e6052 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:04.881564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 747/1476] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:04.887053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1483-63b0-4f0e-8e73-c42c7875a040 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:04.887480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1483-63b0-4f0e-8e73-c42c7875a040 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:04.887605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1483-63b0-4f0e-8e73-c42c7875a040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:04.953703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3dad1483-63b0-4f0e-8e73-c42c7875a040 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:04.954916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3dad1483-63b0-4f0e-8e73-c42c7875a040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:05.055555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 730/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:05.334746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c627f9e-3859-4b7c-aa7c-2b71968e6052 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:05.336279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2c627f9e-3859-4b7c-aa7c-2b71968e6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:05.465108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c627f9e-3859-4b7c-aa7c-2b71968e6052 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:05.515738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:05.566167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:05.566773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:05.567052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:05.567323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:05.567959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:05.569732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:42:05.569732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:42:05.569732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:42:05.570870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e89ee7-c9cf-4f2c-9f3d-824e41c48774 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:05.591313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 748/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:05 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:42:07.791683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43ae1-9a37-40c5-9c58-648a48b9b6a9 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:07.792266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43ae1-9a37-40c5-9c58-648a48b9b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:07.792266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43ae1-9a37-40c5-9c58-648a48b9b6a9 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:07.793594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 731/1479] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:07.799597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea646883-580c-4071-9fdb-b8f3793f1685 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:07.800061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea646883-580c-4071-9fdb-b8f3793f1685 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:07.800176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea646883-580c-4071-9fdb-b8f3793f1685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:07.866573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ea646883-580c-4071-9fdb-b8f3793f1685 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:07.867788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ea646883-580c-4071-9fdb-b8f3793f1685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:07.965763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 749/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:08.264057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43ae1-9a37-40c5-9c58-648a48b9b6a9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:08.265999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-50c43ae1-9a37-40c5-9c58-648a48b9b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:08.275960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:08.410287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43ae1-9a37-40c5-9c58-648a48b9b6a9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:08.490613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:08.525067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:08.525674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:08.525948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:08.526217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:08.527800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:08.618509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:08.620103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980239e7-ebb7-4cdb-a764-7ed4cee2b6e7 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:08.640084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 732/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:10.997730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e902d3-a736-45d3-9dc7-b46fa592235e None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:10.998310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e902d3-a736-45d3-9dc7-b46fa592235e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:10.998310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e902d3-a736-45d3-9dc7-b46fa592235e None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:10.999997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 750/1482] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:11.006196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be272b-02fe-47e5-85a8-ff1bcb183cf5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:11.006926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be272b-02fe-47e5-85a8-ff1bcb183cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:11.006926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be272b-02fe-47e5-85a8-ff1bcb183cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:11.073018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-97be272b-02fe-47e5-85a8-ff1bcb183cf5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:11.074236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-97be272b-02fe-47e5-85a8-ff1bcb183cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:11.122771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:11.174925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 733/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:11.465762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e902d3-a736-45d3-9dc7-b46fa592235e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:11.467337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14e902d3-a736-45d3-9dc7-b46fa592235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:11.492273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:11.576353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e902d3-a736-45d3-9dc7-b46fa592235e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:11.656299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:11.656942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:11.657223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:11.657492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:11.659099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:11.734877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:11.770373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:11.771803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418b67-0f36-4cb1-b22f-e1c0623285e3 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:11.789896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 751/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:14.033382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd280-0263-4e88-9a79-37134bfc2b8e None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.033966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd280-0263-4e88-9a79-37134bfc2b8e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.033966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd280-0263-4e88-9a79-37134bfc2b8e None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.035282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 734/1485] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:14.040635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff377b-04c7-4fcf-bfd3-ab84e7c18827 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.041085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff377b-04c7-4fcf-bfd3-ab84e7c18827 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.041211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff377b-04c7-4fcf-bfd3-ab84e7c18827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.106903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-22ff377b-04c7-4fcf-bfd3-ab84e7c18827 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:14.108134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-22ff377b-04c7-4fcf-bfd3-ab84e7c18827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:14.208576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 752/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:14.506941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd280-0263-4e88-9a79-37134bfc2b8e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:14.508511 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a8bdd280-0263-4e88-9a79-37134bfc2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:14.614529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd280-0263-4e88-9a79-37134bfc2b8e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:14.687369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:14.688917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:14.689590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.690172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.690356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.692637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:14.811819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:14.813293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99adc8-b637-4d76-9e68-b5ee66652949 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:14.832969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 735/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:17.156846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51382-a411-4b56-aaed-34a148257a84 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.157405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51382-a411-4b56-aaed-34a148257a84 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.157405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51382-a411-4b56-aaed-34a148257a84 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.158711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 753/1488] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:17.164051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af539-8c05-44ed-9668-9f8343e7d8dd None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.164455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af539-8c05-44ed-9668-9f8343e7d8dd None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.164594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af539-8c05-44ed-9668-9f8343e7d8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.230838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c86af539-8c05-44ed-9668-9f8343e7d8dd None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:17.232037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c86af539-8c05-44ed-9668-9f8343e7d8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:17.283319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.326677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 736/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:17.616560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51382-a411-4b56-aaed-34a148257a84 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.618128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e0a51382-a411-4b56-aaed-34a148257a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:17.654132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.724257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51382-a411-4b56-aaed-34a148257a84 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.799358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.799966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.800245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.800512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.802157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:17.884380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.914041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.915481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873296a-953a-46b7-b882-da43103b5680 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:17.933422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 754/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:20.333934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3e1c-778d-4f0f-b7e4-559e716eb3b5 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:20.334504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3e1c-778d-4f0f-b7e4-559e716eb3b5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:20.334504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3e1c-778d-4f0f-b7e4-559e716eb3b5 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:20.335862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 737/1491] 10.222.0.45 () {54 vars in 927 bytes} [Tue Oct 4 08:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:20.341344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad776c6-2a75-4de4-b833-9a6042d0cc9d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:20.341816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad776c6-2a75-4de4-b833-9a6042d0cc9d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:20.341915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad776c6-2a75-4de4-b833-9a6042d0cc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:20.408819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1ad776c6-2a75-4de4-b833-9a6042d0cc9d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:20.410041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1ad776c6-2a75-4de4-b833-9a6042d0cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:20.506549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 755/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:42:20.812120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3e1c-778d-4f0f-b7e4-559e716eb3b5 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:20.813683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-24bf3e1c-778d-4f0f-b7e4-559e716eb3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:20.916952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3e1c-778d-4f0f-b7e4-559e716eb3b5 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:21.000740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:21.001364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:21.001647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:21.001922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:21.003706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:21.015046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:21.126350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:21.128979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4548104-5167-4d8f-9c6d-127edecfc630 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:21.146896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 738/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:42:30.504978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=82 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:31.144628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=50 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.128569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.129193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.129193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.206006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:35.207246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.310110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 756/1494] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:35.318139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.318672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.318672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.395418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:35.396529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.493108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 739/1495] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:35.498447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.499661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.511549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9bb89-31d7-40eb-928c-11f96911eafe None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.573588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.609393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.609997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.610274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.610546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.611184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:35.611483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.612528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:35.612528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:43:35.612528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:43:35.613444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.625294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 757/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:35.633761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.643195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121aff-66bf-4398-8bd2-2601d6007b70 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.704999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.739584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.740200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.740476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.740766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.741403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.743119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:35.743119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:43:35.743119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:43:35.744352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.800961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 740/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:43:35 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:43:35.805155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.806666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.840432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499638-4379-48c9-926c-0a9be926fce8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.935466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.936070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.936347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.936618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.937289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.938299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:35.938299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:43:35.938299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:43:35.939501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.982853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 758/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:43:35 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:35.987095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.988611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.062080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19c30e-1e9b-4d66-9c5e-2c2d2ec19ac7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.148498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.161147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.161757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.162034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.162305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.162948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.163965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:36.163965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:43:36.163965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:43:36.164880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.178345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 741/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:43:36.182435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.184670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.195855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68591-dee7-42fe-aba1-b82e2b1738bd admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.221222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.291207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.291805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.292078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.292341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.293034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.294044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:36.294044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:43:36.294044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:43:36.294925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcafd-83e9-474a-b3e2-eaf3fc572d7a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.307054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 759/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:43:36.311983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.313551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.347257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e12c-07dd-4ee6-bb66-e12599e27c33 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.442587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.443250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.443528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.443796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] PATH_INFO: `/v3/projects/7b0bba5217034f0e9475b903fe000c1b/users/e2ab50cd1b864fcdb84a050897ab64df/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.466747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0bba5217034f0e9475b903fe000c1b, user_id=e2ab50cd1b864fcdb84a050897ab64df, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.467788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:36.467788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:43:36.467788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:43:36.469775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db4a3d-1536-4c79-a589-e49f0f41a7f2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.494079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 742/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:43:36 2022] PUT /identity/v3/projects/7b0bba5217034f0e9475b903fe000c1b/users/e2ab50cd1b864fcdb84a050897ab64df/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:36.507004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382762cd-b9b6-4e6e-acef-2e2abbc75b09 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.507294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382762cd-b9b6-4e6e-acef-2e2abbc75b09 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.507650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382762cd-b9b6-4e6e-acef-2e2abbc75b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.565700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-382762cd-b9b6-4e6e-acef-2e2abbc75b09 None None] MFA Rules not processed for user `e2ab50cd1b864fcdb84a050897ab64df`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:36.566833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-382762cd-b9b6-4e6e-acef-2e2abbc75b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.646715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 760/1502] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:36.659903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116e5e0-657d-4036-8b58-e854504f9680 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.660193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116e5e0-657d-4036-8b58-e854504f9680 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.660489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116e5e0-657d-4036-8b58-e854504f9680 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.661834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 743/1503] 10.222.0.45 () {54 vars in 963 bytes} [Tue Oct 4 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:36.667328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42a973-7fc4-491d-8af8-8d531ecc236d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.667616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42a973-7fc4-491d-8af8-8d531ecc236d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.668415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42a973-7fc4-491d-8af8-8d531ecc236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.700820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.747604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9a42a973-7fc4-491d-8af8-8d531ecc236d None None] MFA Rules not processed for user `511d91463bbf43ef878a3111e4c11b73`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:36.748849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9a42a973-7fc4-491d-8af8-8d531ecc236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.823500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 761/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Tue Oct 4 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:36.833176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116e5e0-657d-4036-8b58-e854504f9680 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.834679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7116e5e0-657d-4036-8b58-e854504f9680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.885025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.939411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116e5e0-657d-4036-8b58-e854504f9680 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.023010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.023649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.023932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.024217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.025825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:37.129940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.131393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.134991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.150107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 744/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:43:37.196560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfa246-992a-460b-967d-a504b83fefea None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.197012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfa246-992a-460b-967d-a504b83fefea None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.197158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfa246-992a-460b-967d-a504b83fefea None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.198421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 762/1506] 10.222.0.45 () {52 vars in 830 bytes} [Tue Oct 4 08:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:37.202260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.203457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:37.306961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6946da-e951-4e7f-846a-c9388b660ac8 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.413150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.413821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.413966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.414239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] PATH_INFO: `/v3/users/e2ab50cd1b864fcdb84a050897ab64df` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.427836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ab50cd1b864fcdb84a050897ab64df)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.428904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:37.428904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:43:37.428904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:43:37.430138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.440456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.499666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ab50cd1b864fcdb84a050897ab64df'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:37.500185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ab50cd1b864fcdb84a050897ab64df'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:37.514333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ab50cd1b864fcdb84a050897ab64df'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:37.523989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ab50cd1b864fcdb84a050897ab64df'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:37.524430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ab50cd1b864fcdb84a050897ab64df'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:37.553662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 745/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:43:37 2022] DELETE /identity/v3/users/e2ab50cd1b864fcdb84a050897ab64df => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:37.558044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.558334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.558702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.617525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:37.619068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:37.699786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.713141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 763/1508] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:37.723415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.724698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:37.829922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa6943-6dea-4f26-965d-c586a709fd31 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.885114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.907548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.908172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.908457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.908745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.910361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:38.029258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.031342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13f4c5-30d7-446d-9e1d-c095bf9663f6 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.050001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 746/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:38.417716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.419065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:38.430433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446dc65-2952-4741-aa60-4a45ddb59efb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.528803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.529432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.529714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.529986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] PATH_INFO: `/v3/projects/7b0bba5217034f0e9475b903fe000c1b` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.540586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0bba5217034f0e9475b903fe000c1b)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.541646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:43:38.541646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:43:38.541646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:43:38.542890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.601034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0bba5217034f0e9475b903fe000c1b', 'request_id': 'req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:38.613858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0bba5217034f0e9475b903fe000c1b', 'request_id': 'req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:38.624278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0bba5217034f0e9475b903fe000c1b', 'request_id': 'req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:38.647233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] The token cache is being invalidate because project 7b0bba5217034f0e9475b903fe000c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:43:38.647519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:38.648038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8fa866f-79a0-4a9f-ab63-6c39dcc0e42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:43:38.649405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 764/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:43:38 2022] DELETE /identity/v3/projects/7b0bba5217034f0e9475b903fe000c1b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:48.047661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=62 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:48.645210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:13.230828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf583654-f27c-42b2-8a7d-f580c8670238 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.231437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf583654-f27c-42b2-8a7d-f580c8670238 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.231437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf583654-f27c-42b2-8a7d-f580c8670238 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.232755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:13.237664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89338b-7655-4bf0-8901-0675ec10b20f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.238169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89338b-7655-4bf0-8901-0675ec10b20f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.238274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89338b-7655-4bf0-8901-0675ec10b20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.320661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7c89338b-7655-4bf0-8901-0675ec10b20f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:13.321956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7c89338b-7655-4bf0-8901-0675ec10b20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:13.430408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:13.588851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf583654-f27c-42b2-8a7d-f580c8670238 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.591137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bf583654-f27c-42b2-8a7d-f580c8670238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:13.710784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf583654-f27c-42b2-8a7d-f580c8670238 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.716393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051e85e-57cb-45ef-8326-aa55eca62531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.717057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e85e-57cb-45ef-8326-aa55eca62531 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.717387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e85e-57cb-45ef-8326-aa55eca62531 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.717661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e85e-57cb-45ef-8326-aa55eca62531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.726703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e85e-57cb-45ef-8326-aa55eca62531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.728303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051e85e-57cb-45ef-8326-aa55eca62531 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.738682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 748/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:14.841260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942887b-caa9-406c-a435-08a109b61375 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.841835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942887b-caa9-406c-a435-08a109b61375 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.841835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942887b-caa9-406c-a435-08a109b61375 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.843126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:45:14.849687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446d94b-9aed-49f7-b2ad-52978f3b2839 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.850104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446d94b-9aed-49f7-b2ad-52978f3b2839 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.850222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446d94b-9aed-49f7-b2ad-52978f3b2839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.869411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e446d94b-9aed-49f7-b2ad-52978f3b2839 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:14.870595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e446d94b-9aed-49f7-b2ad-52978f3b2839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:14.878838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:15.024087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9309d-15b1-4cb3-b0a8-c95146341ac5 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:15.024375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9309d-15b1-4cb3-b0a8-c95146341ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:15.024678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9309d-15b1-4cb3-b0a8-c95146341ac5 None None] PATH_INFO: `/v3` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:15.025996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 767/1516] 10.222.0.13 () {54 vars in 925 bytes} [Tue Oct 4 08:45:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:15.032376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663a07-de1c-4c74-9fe5-4d118e614028 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:15.032659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9309d-15b1-4cb3-b0a8-c95146341ac5 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:15.032809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663a07-de1c-4c74-9fe5-4d118e614028 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:15.033012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663a07-de1c-4c74-9fe5-4d118e614028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:15.047567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9309d-15b1-4cb3-b0a8-c95146341ac5 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:15.053604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be636aa4-ff0d-41be-88df-ed42f21e76a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:15.054218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636aa4-ff0d-41be-88df-ed42f21e76a0 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:15.054503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636aa4-ff0d-41be-88df-ed42f21e76a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:15.054778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636aa4-ff0d-41be-88df-ed42f21e76a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:15.063739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be636aa4-ff0d-41be-88df-ed42f21e76a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:15.065400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be636aa4-ff0d-41be-88df-ed42f21e76a0 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:15.077076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 768/1517] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:45:15.100179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-62663a07-de1c-4c74-9fe5-4d118e614028 None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:15.101448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-62663a07-de1c-4c74-9fe5-4d118e614028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:15.165736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:15.187773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 750/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Oct 4 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:18.749976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3b52-a52d-4885-b48a-d4d5263a41df None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:18.750534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3b52-a52d-4885-b48a-d4d5263a41df None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:18.750534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3b52-a52d-4885-b48a-d4d5263a41df None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:18.751851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 769/1519] 10.222.0.45 () {54 vars in 961 bytes} [Tue Oct 4 08:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:45:18.757375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455a0d-a404-4ce4-a223-31cb6f10fce8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:18.757877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455a0d-a404-4ce4-a223-31cb6f10fce8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:18.757988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455a0d-a404-4ce4-a223-31cb6f10fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:18.785926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-80455a0d-a404-4ce4-a223-31cb6f10fce8 None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:18.787142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-80455a0d-a404-4ce4-a223-31cb6f10fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:18.797209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 751/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Oct 4 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:18.804868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3b52-a52d-4885-b48a-d4d5263a41df None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:18.819960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3b52-a52d-4885-b48a-d4d5263a41df None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:18.825311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df6f37-45e5-4355-84e6-3194d5954f87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:18.825911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6f37-45e5-4355-84e6-3194d5954f87 service placement] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:18.826187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6f37-45e5-4355-84e6-3194d5954f87 service placement] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:18.826454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6f37-45e5-4355-84e6-3194d5954f87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:18.834856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df6f37-45e5-4355-84e6-3194d5954f87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:18.836419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df6f37-45e5-4355-84e6-3194d5954f87 service placement] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:18.846641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 770/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:26.580747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7586-887a-47bd-84de-b46cd830bee6 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:26.581294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7586-887a-47bd-84de-b46cd830bee6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:26.581294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7586-887a-47bd-84de-b46cd830bee6 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:26.582657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:26.589150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566845a6-f6a0-4b1d-ad8f-3e89faa137f5 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:26.589678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566845a6-f6a0-4b1d-ad8f-3e89faa137f5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:26.589776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566845a6-f6a0-4b1d-ad8f-3e89faa137f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:26.609502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-566845a6-f6a0-4b1d-ad8f-3e89faa137f5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:26.610686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-566845a6-f6a0-4b1d-ad8f-3e89faa137f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:26.618353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:26.776506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7586-887a-47bd-84de-b46cd830bee6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:26.791075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7586-887a-47bd-84de-b46cd830bee6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:26.797146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a868a-c5b1-4b04-8a79-1ef275ce0943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:26.797739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a868a-c5b1-4b04-8a79-1ef275ce0943 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:26.798018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a868a-c5b1-4b04-8a79-1ef275ce0943 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:26.798287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a868a-c5b1-4b04-8a79-1ef275ce0943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:26.806452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a868a-c5b1-4b04-8a79-1ef275ce0943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:26.808035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a868a-c5b1-4b04-8a79-1ef275ce0943 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:26.818268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 753/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:27.906690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7b35b-865f-4dde-8d02-6c4a46092783 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:27.907278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7b35b-865f-4dde-8d02-6c4a46092783 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:27.907278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7b35b-865f-4dde-8d02-6c4a46092783 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:27.908550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:27.914878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120fa4-705e-449c-aa16-745d77d9fc50 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:27.915337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120fa4-705e-449c-aa16-745d77d9fc50 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:27.915487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120fa4-705e-449c-aa16-745d77d9fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:27.935189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2d120fa4-705e-449c-aa16-745d77d9fc50 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:27.936409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2d120fa4-705e-449c-aa16-745d77d9fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:27.944160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:28.099726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7b35b-865f-4dde-8d02-6c4a46092783 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:28.114837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7b35b-865f-4dde-8d02-6c4a46092783 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:28.120601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05412369-3a63-4dec-86e4-ebbe75886bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:28.121967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05412369-3a63-4dec-86e4-ebbe75886bd3 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:28.122251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05412369-3a63-4dec-86e4-ebbe75886bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:28.122527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05412369-3a63-4dec-86e4-ebbe75886bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:28.131603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05412369-3a63-4dec-86e4-ebbe75886bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:28.133255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05412369-3a63-4dec-86e4-ebbe75886bd3 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:28.143525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 773/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:32.345751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc90b7-6acd-47c3-af4d-d8edf8ceaf35 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.346271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc90b7-6acd-47c3-af4d-d8edf8ceaf35 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.346271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc90b7-6acd-47c3-af4d-d8edf8ceaf35 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.347830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:32.353067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa926c-0404-4df2-9db9-bd2dcf208dae None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.353494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa926c-0404-4df2-9db9-bd2dcf208dae None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.353603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa926c-0404-4df2-9db9-bd2dcf208dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.375288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-68fa926c-0404-4df2-9db9-bd2dcf208dae None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:32.376486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-68fa926c-0404-4df2-9db9-bd2dcf208dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:32.384226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:32.675804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc90b7-6acd-47c3-af4d-d8edf8ceaf35 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:32.677540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-03bc90b7-6acd-47c3-af4d-d8edf8ceaf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:32.757835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc90b7-6acd-47c3-af4d-d8edf8ceaf35 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:32.762183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31013-b8dc-429c-b3c1-a85ff548181b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:32.762950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31013-b8dc-429c-b3c1-a85ff548181b service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.763226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31013-b8dc-429c-b3c1-a85ff548181b service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.763491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31013-b8dc-429c-b3c1-a85ff548181b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.772411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31013-b8dc-429c-b3c1-a85ff548181b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:32.773857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31013-b8dc-429c-b3c1-a85ff548181b service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:32.783458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 756/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:34.945664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db9f20-8acc-4bd8-8c96-c91fc7fff814 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:34.946273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db9f20-8acc-4bd8-8c96-c91fc7fff814 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:34.946273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db9f20-8acc-4bd8-8c96-c91fc7fff814 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:34.947923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:34.953979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2941-974b-493c-b6fd-11e3386e0a23 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:34.954410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2941-974b-493c-b6fd-11e3386e0a23 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:34.954531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2941-974b-493c-b6fd-11e3386e0a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:34.982154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d44c2941-974b-493c-b6fd-11e3386e0a23 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:34.983383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d44c2941-974b-493c-b6fd-11e3386e0a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:34.991535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:35.284062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db9f20-8acc-4bd8-8c96-c91fc7fff814 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:35.296228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db9f20-8acc-4bd8-8c96-c91fc7fff814 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:35.299908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f801b1-9a29-47ed-af6f-957cbee9cf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:35.300502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f801b1-9a29-47ed-af6f-957cbee9cf30 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:35.300813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f801b1-9a29-47ed-af6f-957cbee9cf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:35.301085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f801b1-9a29-47ed-af6f-957cbee9cf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:35.311338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f801b1-9a29-47ed-af6f-957cbee9cf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:35.312812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f801b1-9a29-47ed-af6f-957cbee9cf30 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:35.323668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 776/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:38.953966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359b1b-776c-4e8e-a104-12b4196d1b9c None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:38.954638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359b1b-776c-4e8e-a104-12b4196d1b9c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:38.954952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359b1b-776c-4e8e-a104-12b4196d1b9c None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:38.956959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:38.963432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a121-161c-4dcf-af2c-eb8190a5d542 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:38.963925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a121-161c-4dcf-af2c-eb8190a5d542 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:38.964132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a121-161c-4dcf-af2c-eb8190a5d542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:38.971906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:38.985818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1876a121-161c-4dcf-af2c-eb8190a5d542 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:38.987064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1876a121-161c-4dcf-af2c-eb8190a5d542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:38.995033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:39.305549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359b1b-776c-4e8e-a104-12b4196d1b9c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:39.307224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ff359b1b-776c-4e8e-a104-12b4196d1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:39.386867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359b1b-776c-4e8e-a104-12b4196d1b9c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:39.390460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4021d64-c2a8-4ed0-998e-a3441c700e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:39.391099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4021d64-c2a8-4ed0-998e-a3441c700e15 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:39.391407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4021d64-c2a8-4ed0-998e-a3441c700e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:39.391682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4021d64-c2a8-4ed0-998e-a3441c700e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:39.400785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4021d64-c2a8-4ed0-998e-a3441c700e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:39.403283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4021d64-c2a8-4ed0-998e-a3441c700e15 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:39.413132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 759/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:41.803940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b53f-a352-4b6b-b053-c44feae46e27 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:41.804509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b53f-a352-4b6b-b053-c44feae46e27 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:41.804509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b53f-a352-4b6b-b053-c44feae46e27 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:41.805845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:41.811591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c39f5-9098-4588-ba91-dd1835b59456 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:41.812014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c39f5-9098-4588-ba91-dd1835b59456 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:41.812174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c39f5-9098-4588-ba91-dd1835b59456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:41.832587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ce0c39f5-9098-4588-ba91-dd1835b59456 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:41.833746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ce0c39f5-9098-4588-ba91-dd1835b59456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:41.842263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:42.156620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b53f-a352-4b6b-b053-c44feae46e27 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:42.158360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3188b53f-a352-4b6b-b053-c44feae46e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:42.171194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b53f-a352-4b6b-b053-c44feae46e27 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:42.174697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a4ee-8a8f-4edb-8fe2-6d011b7fa725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:42.175292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a4ee-8a8f-4edb-8fe2-6d011b7fa725 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:42.175576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a4ee-8a8f-4edb-8fe2-6d011b7fa725 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:42.175845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a4ee-8a8f-4edb-8fe2-6d011b7fa725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:42.185652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23a4ee-8a8f-4edb-8fe2-6d011b7fa725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:42.187090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23a4ee-8a8f-4edb-8fe2-6d011b7fa725 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:42.197883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 779/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:51.827501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:52.192260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=8 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:09.926526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047334a2-0ac1-4f6c-a146-3b2c54d9b88c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.927186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047334a2-0ac1-4f6c-a146-3b2c54d9b88c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.927186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047334a2-0ac1-4f6c-a146-3b2c54d9b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.934172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a7af6-62a4-460c-8811-4f5217c4da3a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.935132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a7af6-62a4-460c-8811-4f5217c4da3a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.935630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a7af6-62a4-460c-8811-4f5217c4da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.953803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-047334a2-0ac1-4f6c-a146-3b2c54d9b88c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:09.955144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-047334a2-0ac1-4f6c-a146-3b2c54d9b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:09.965000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a00a7af6-62a4-460c-8811-4f5217c4da3a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:09.966221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a00a7af6-62a4-460c-8811-4f5217c4da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:09.970875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 761/1540] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:09.980414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becc63c-c037-422a-82c2-109b1248daa2 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.980763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becc63c-c037-422a-82c2-109b1248daa2 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.981141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becc63c-c037-422a-82c2-109b1248daa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.985771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 780/1541] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.010732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5becc63c-c037-422a-82c2-109b1248daa2 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.012107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5becc63c-c037-422a-82c2-109b1248daa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.015314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff678f-8e44-4a08-b257-9f531f220d32 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.015606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff678f-8e44-4a08-b257-9f531f220d32 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.015892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff678f-8e44-4a08-b257-9f531f220d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.030835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 762/1542] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:10.032371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.032656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.032956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.047014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e6ff678f-8e44-4a08-b257-9f531f220d32 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.048234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e6ff678f-8e44-4a08-b257-9f531f220d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.066763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.067967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.070376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 781/1543] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:10.071535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143ce94-0ef8-4a07-9e03-48196385c10c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.071920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143ce94-0ef8-4a07-9e03-48196385c10c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.072206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143ce94-0ef8-4a07-9e03-48196385c10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.080614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 763/1544] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.082355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.096799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8817-2644-4d70-91ed-fbaaa69cce65 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.118214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9143ce94-0ef8-4a07-9e03-48196385c10c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.118214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9143ce94-0ef8-4a07-9e03-48196385c10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.119678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.120305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.120584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.120884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.121548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.122354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.126927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:10.126927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:47:10.126927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:47:10.126927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.148444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 782/1545] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.152752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 764/1546] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.152752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.153368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afdf12-02e4-467b-863d-e500ff44a04d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.153669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afdf12-02e4-467b-863d-e500ff44a04d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.153946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afdf12-02e4-467b-863d-e500ff44a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.171239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06bcd7-faee-4808-ae9a-609a0af4d64c admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.175934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.176602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.176858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.177118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.177765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.178066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.179738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f9b68-e2a9-40db-8ae4-e0bb8f979310 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.182313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-93afdf12-02e4-467b-863d-e500ff44a04d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.183613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-93afdf12-02e4-467b-863d-e500ff44a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.194075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 765/1547] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.195356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e28253-9f86-499c-aaeb-f3cb02452175 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.195656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e28253-9f86-499c-aaeb-f3cb02452175 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.200217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e28253-9f86-499c-aaeb-f3cb02452175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.200370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 783/1548] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.200370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.200370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.200370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.226873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.228102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.229629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d2e28253-9f86-499c-aaeb-f3cb02452175 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.230801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d2e28253-9f86-499c-aaeb-f3cb02452175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.236361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 784/1549] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.237208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.242724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 766/1550] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.242724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed897-219a-48a6-80af-2d7fa675aa2f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.242724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed897-219a-48a6-80af-2d7fa675aa2f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.242724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ed897-219a-48a6-80af-2d7fa675aa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.248617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce0a2-299e-4840-bfdd-60e47fe91e52 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.253427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.254100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.254442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.254824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.255515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.256618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:10.256618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:47:10.256618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:47:10.258025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d728b0d-35eb-43cb-8730-ec66683eafdb admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.260923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a64ed897-219a-48a6-80af-2d7fa675aa2f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.262118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a64ed897-219a-48a6-80af-2d7fa675aa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.270412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 767/1551] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.271837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987042-c04f-4c87-b257-77b41b564f9d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.272123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987042-c04f-4c87-b257-77b41b564f9d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.272396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987042-c04f-4c87-b257-77b41b564f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.293868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-74987042-c04f-4c87-b257-77b41b564f9d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.295851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-74987042-c04f-4c87-b257-77b41b564f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.304080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 768/1552] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.305318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.305605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.305881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 785/1553] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.306002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.307220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.307545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.307787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.326200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.327407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.327593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.328763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.388904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 786/1554] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.390095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 769/1555] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.390329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.390566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.406742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cff57f-1291-42ec-b678-fa6d82dc4c4f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.407049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94b5b-9922-4597-b0d1-049f3dbb100c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.411579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b507d-25d8-4360-a450-a38cf4f50ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.411765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.412184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b507d-25d8-4360-a450-a38cf4f50ddf admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.412393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.412514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b507d-25d8-4360-a450-a38cf4f50ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.412669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.412818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b507d-25d8-4360-a450-a38cf4f50ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.412961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.413596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b507d-25d8-4360-a450-a38cf4f50ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.413713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.414018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.415530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b507d-25d8-4360-a450-a38cf4f50ddf admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.415836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b59e-2533-4480-bd53-4b04ffe346d7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.428103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 770/1556] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.429541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.429825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.430102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.449294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 787/1557] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.450562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.450847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.451121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.453417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.454617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.471615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.472832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.515728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 771/1558] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.516772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.530345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754018-5364-4fca-bf9c-159ee03287cf None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.535023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 788/1559] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.535191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.535624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.535864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.536031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.536384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.537073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.537367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.539148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.547875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131ef41-f4e3-448a-9cd2-5145c2365ba9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.550996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 772/1560] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.552021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.559862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.560490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.560854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.561131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.561609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6f62-f467-410a-91c7-ac3815730958 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.561822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.563766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.566177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.566766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.567045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.567388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.568028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.568333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.570485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa19-4d53-4a9f-81df-e686d8c81595 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.573063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.581277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.584579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 773/1561] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.586883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.587179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.587429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.599516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 789/1562] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/users => generated 283 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.600378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.607530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:10.608733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:10.610099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0ee61-3b68-415a-8a90-cf136bfe0337 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.615344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.615971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.616322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.616746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.617665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.621489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 774/1563] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:10.621489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.621747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.628983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85de6a7-59de-4610-9084-8a3c2bd101ef None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.634902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.635509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.635792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.636067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.636694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.637738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:10.637738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:47:10.637738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:47:10.638961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.650158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 790/1564] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.654584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.663257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 775/1565] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.664857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.674800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b25b3-7da8-4226-816d-695e2c78ed00 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.719680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d722bdd-9ad5-4b25-a55c-a1ea465d2ad5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.724584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.725253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.725536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.725929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.727155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.727466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.729125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.733500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.734104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.734384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.734659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.735308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.735605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.737252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.740736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 791/1566] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.741562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.750012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 776/1567] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.750675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.751174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046c26-8e2b-4270-9783-8b2651b77726 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.759839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.760455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.760570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a22a-ff1e-4b2e-ab22-20eb7b2f3078 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.760791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.761066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.761732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.763664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.765147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.765748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.766027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.766302 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.766980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.772049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.794920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 792/1568] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.795866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.807012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 777/1569] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.807795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.862970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aa16-a6c2-4c5d-ab9e-0e0f60b7d342 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.872265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11207-bf8b-4eeb-85cb-2afc6a8ca5cf admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.876930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.877547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.877820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.878088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.878731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.879026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.880626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.893303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 778/1570] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.894120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.906890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8fb0-7452-45a4-a75c-3ece1bd339a6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.912091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.913200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.914606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.914887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.915521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.917470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.923730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.933207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.934416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.935225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.935477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.936125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.937775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.940495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 779/1571] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:10.941416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.948404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 793/1572] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:10.949273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.952600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442740a-0055-4acd-b81b-d35daf366ef3 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.958251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.958697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.958975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.959247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.959457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44ea5-759c-4fa6-b501-12bc33da0df0 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.959891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.962038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.964961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.965569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.965849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.966124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.966756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.968669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.973126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 780/1573] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:10.973932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.987329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070b25d-b634-48b9-8b20-8a4fc218b070 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.992004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.992607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.992939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.993212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.993837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.995731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.001223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.004737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 794/1574] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.005562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.028321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 781/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:10 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.028321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.075785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00033568-7d4a-4eec-9aba-eea576ef9356 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.091020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a85f7e-7160-47c0-90d2-cc6943698122 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.096226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.096887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.097173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.097445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.098104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.100072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.124772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 782/1576] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.125645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.137803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.138515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.138995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.139459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.140507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.142008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14231b-6f55-4d4c-bc2e-c7da9cfa9e16 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.142540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.146321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.146927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.147207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.147606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.148974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.150963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.168929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 795/1577] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.168929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.179708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc810b0-3d52-4c1e-bcb9-543a72b3a88d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.180352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 783/1578] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.181159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.243506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.244012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.244294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.244519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566847f3-ebc0-4dcf-8069-5ca0b66448cc admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.244637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.245240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.246919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.249454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.250057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.250342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.250617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.251262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.252896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.260969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 796/1579] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.260969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.264064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 784/1580] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.264918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.265601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.270814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df8a2a-63c6-4ebc-b0ed-7bb046db250a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.275450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2ec2c-334c-42bf-b72b-d5e7ddfdfdfa admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.277606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.278207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.278490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.278761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.279402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.279930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.280514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.280818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.281042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.281146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.281702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.283640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.291911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 797/1581] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.293183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.303979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9badac-fb63-4b97-8c6c-2d61f6427ebc admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.305877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 785/1582] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.306713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.309390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.310002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.310279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.310580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.311235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.313336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.316936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d2c7-0c1c-4552-b86c-d5aef629e1fa admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.322253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.322852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.323130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.323399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.324042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.325701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.337095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 798/1583] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.337963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.338784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 786/1584] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.339594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.350030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876112f-9c26-4e69-8308-9f5013ab4f2a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.350425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868098e-0772-4ca8-a7db-e2d774e8b0e3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.354986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.355147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.355593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.355704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.355874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.355982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.356146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.356286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.356810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.356921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.358423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.358738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.369189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 799/1585] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.370015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.380554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ba45-9504-40c7-a0ef-b00572421090 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.382946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 787/1586] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:11.383871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.386669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.387268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.387546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.387824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.388454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.390096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.391162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.395104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c90721-7533-4264-a3c4-f031ff7bb43f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.401136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.401480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 800/1587] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.401921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.402205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.402328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.402496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] PATH_INFO: `/v3/projects/c232aa58e8624eef92dfa84060b21f1e/users/1c4a45eff71541539ca9064be4b90a2a/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.412427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645722b-517f-4917-825c-be5c42490ec3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.417832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.418362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c232aa58e8624eef92dfa84060b21f1e, user_id=1c4a45eff71541539ca9064be4b90a2a, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.418497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.418756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.419031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] PATH_INFO: `/v3/projects/462ebb2d073947f09aa29402780dedfa/users/77a2d8ba621743bca39b7382fb8a9611/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.421056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.435203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 788/1588] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:11 2022] PUT /identity/v3/projects/c232aa58e8624eef92dfa84060b21f1e/users/1c4a45eff71541539ca9064be4b90a2a/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:11.435844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] RBAC: Authorizing `identity:create_grant(project_id=462ebb2d073947f09aa29402780dedfa, user_id=77a2d8ba621743bca39b7382fb8a9611, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.436682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.436927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:11.436927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:47:11.436927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:47:11.438865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.455838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 801/1589] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:11 2022] PUT /identity/v3/projects/462ebb2d073947f09aa29402780dedfa/users/77a2d8ba621743bca39b7382fb8a9611/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:11.456665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.519863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabfd0-6983-43b8-a975-595504f9550f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.521007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7988-1770-4474-987c-2bb7a4c86994 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.525181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.525792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.526076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.526347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.526854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.526986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.527492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.528057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.528336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.528592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.529007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.531248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.539160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 802/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.539995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.543126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 789/1591] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.544104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.551080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55353a0e-4b6e-4a35-8655-84359260da3c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.556223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f45560-1136-43cb-a8ff-c225560fb0a5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.556378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.557015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.557299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.557574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.558244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.562619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.562777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.562777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.562777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.562777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.563125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.564370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.572398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 803/1592] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.576223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.581606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 790/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.582297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.584230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989c1e-9f6c-4436-9ff6-ff30bb687f15 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.588977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d191-9995-4636-9ede-57425dece5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.589593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d191-9995-4636-9ede-57425dece5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.589873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d191-9995-4636-9ede-57425dece5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.590145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d191-9995-4636-9ede-57425dece5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.590784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76d191-9995-4636-9ede-57425dece5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.592395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76d191-9995-4636-9ede-57425dece5c3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.594501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698ffe-3062-4221-b2a8-87a4e0f2e9ea admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.599825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b506578-bde2-4a40-a15d-3c8ffec5d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.600574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b506578-bde2-4a40-a15d-3c8ffec5d618 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.600919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b506578-bde2-4a40-a15d-3c8ffec5d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.601375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b506578-bde2-4a40-a15d-3c8ffec5d618 admin admin] PATH_INFO: `/v3/projects/13c9959d127a468385dc6aae67f543b1/users/76f505c66568429baf21e00d2af6ed75/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.603276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 804/1594] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.605253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.605253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.605253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.619947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b506578-bde2-4a40-a15d-3c8ffec5d618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c9959d127a468385dc6aae67f543b1, user_id=76f505c66568429baf21e00d2af6ed75, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.622663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b506578-bde2-4a40-a15d-3c8ffec5d618 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.634532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] MFA Rules not processed for user `1c4a45eff71541539ca9064be4b90a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:11.635756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:11.637649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 791/1595] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:11 2022] PUT /identity/v3/projects/13c9959d127a468385dc6aae67f543b1/users/76f505c66568429baf21e00d2af6ed75/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:11.642068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.642361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.642639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.674146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] MFA Rules not processed for user `77a2d8ba621743bca39b7382fb8a9611`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:11.675381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:11.690736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.711422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 805/1596] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:11.712288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.746677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 792/1597] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:11.747532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.785488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab53d5-b4d4-4e88-aea4-cd88c8b1ccbd None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.789314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.791395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.792013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.792302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.792592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.793342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.795357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.806072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 806/1598] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.806884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.816399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35133a-5e41-4727-adce-bc963b85d2a1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.822397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.824215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb797493-2bda-4943-8fad-90e266c4f55b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.828836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.829761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.830225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.830403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.830514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] PATH_INFO: `/v3/projects/7dc9aa5aa61a4d72ada7082a0165a5b7/users/932fd63e96654e9996b294b7e40e2001/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.830668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.831320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.831962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.833838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.845754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 793/1599] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.846649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc9aa5aa61a4d72ada7082a0165a5b7, user_id=932fd63e96654e9996b294b7e40e2001, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.846832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.849508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.857993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c966-3952-462f-b43e-c38593928b8a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.868917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 807/1600] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:11 2022] PUT /identity/v3/projects/7dc9aa5aa61a4d72ada7082a0165a5b7/users/932fd63e96654e9996b294b7e40e2001/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:11.869872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.930373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.931155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.931322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.932012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] PATH_INFO: `/v3/projects/dd062ec6cfca4743b65fb0b98c6f3d6b/users/f6f4f7ec5b174efb88287c751bd69365/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.939960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98eeed-932e-4145-8f78-9f0fe0fcc7ba admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.944656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b01f-ea4b-4c7e-9f76-31841eba44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.945303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b01f-ea4b-4c7e-9f76-31841eba44e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.945581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b01f-ea4b-4c7e-9f76-31841eba44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.945871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b01f-ea4b-4c7e-9f76-31841eba44e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.946533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b01f-ea4b-4c7e-9f76-31841eba44e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.947131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd062ec6cfca4743b65fb0b98c6f3d6b, user_id=f6f4f7ec5b174efb88287c751bd69365, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.948158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b01f-ea4b-4c7e-9f76-31841eba44e9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.949834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.958861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 808/1601] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:11.962425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6826ae-93b4-4e38-9df5-497f01a8dc56 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.962715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6826ae-93b4-4e38-9df5-497f01a8dc56 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.962989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6826ae-93b4-4e38-9df5-497f01a8dc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.963245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 794/1602] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:11 2022] PUT /identity/v3/projects/dd062ec6cfca4743b65fb0b98c6f3d6b/users/f6f4f7ec5b174efb88287c751bd69365/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:11.964037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.994295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ea6826ae-93b4-4e38-9df5-497f01a8dc56 None None] MFA Rules not processed for user `76f505c66568429baf21e00d2af6ed75`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:11.995519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ea6826ae-93b4-4e38-9df5-497f01a8dc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.030086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f7b34-47ee-48cc-8710-a106318b372b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.035120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.035772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.035997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.036261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.036922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.039462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.044207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:12.065516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 809/1603] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.066852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf0195-55f8-4014-9c0a-44c225dda1cc None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.067152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf0195-55f8-4014-9c0a-44c225dda1cc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.067572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf0195-55f8-4014-9c0a-44c225dda1cc None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.068354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 795/1604] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:11 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:12.068995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.069532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 810/1605] 10.222.0.45 () {54 vars in 961 bytes} [Tue Oct 4 08:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:12.070264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf0195-55f8-4014-9c0a-44c225dda1cc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.114912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:12.140561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf0195-55f8-4014-9c0a-44c225dda1cc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.144743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa933a5-01ff-47fd-9948-b41d3949a8dd admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.146053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f652b8-dcb8-4d35-a0f7-4e15619c8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.146650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f652b8-dcb8-4d35-a0f7-4e15619c8de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.147171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f652b8-dcb8-4d35-a0f7-4e15619c8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.147461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f652b8-dcb8-4d35-a0f7-4e15619c8de9 admin admin] PATH_INFO: `/v3/projects/9cb2556ba8d8495d9fefef939185bdb8/users/2dfb260d28124123a245c857da7e0279/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.149883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.150549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.150825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.151096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] PATH_INFO: `/v3/projects/70a49f262cb54654b0613fad8daa2124/users/0817f0d1febd445e8aeb0e897076f533/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.162688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f652b8-dcb8-4d35-a0f7-4e15619c8de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb2556ba8d8495d9fefef939185bdb8, user_id=2dfb260d28124123a245c857da7e0279, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.165720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a49f262cb54654b0613fad8daa2124, user_id=0817f0d1febd445e8aeb0e897076f533, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.165951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f652b8-dcb8-4d35-a0f7-4e15619c8de9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.168355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.179719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 811/1606] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:12 2022] PUT /identity/v3/projects/9cb2556ba8d8495d9fefef939185bdb8/users/2dfb260d28124123a245c857da7e0279/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:12.181086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2e1e0-8c72-42ad-8f8f-7540c1c8548f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.181373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2e1e0-8c72-42ad-8f8f-7540c1c8548f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.181644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2e1e0-8c72-42ad-8f8f-7540c1c8548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.181771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 796/1607] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:12 2022] PUT /identity/v3/projects/70a49f262cb54654b0613fad8daa2124/users/0817f0d1febd445e8aeb0e897076f533/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:12.182560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.213008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0eb2e1e0-8c72-42ad-8f8f-7540c1c8548f None None] MFA Rules not processed for user `932fd63e96654e9996b294b7e40e2001`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:12.214245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0eb2e1e0-8c72-42ad-8f8f-7540c1c8548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.251046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8670efb-b453-455b-b794-411e4f14f022 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.256548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.257506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.257836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.258114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] PATH_INFO: `/v3/projects/9189457f94be4cf99979395d5cc4bc80/users/52d860c3943a48c5b693994cb45815f7/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.274232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9189457f94be4cf99979395d5cc4bc80, user_id=52d860c3943a48c5b693994cb45815f7, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.276942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.278577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 812/1608] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.279825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.280115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.280393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.299433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 797/1609] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:12 2022] PUT /identity/v3/projects/9189457f94be4cf99979395d5cc4bc80/users/52d860c3943a48c5b693994cb45815f7/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:12.299433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.300584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:12.301820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.359420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7112c0-2c5e-461d-b879-3534df00d10f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.362040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 813/1610] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.362870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.364647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14f7c-bb36-4b77-978e-3cea59805e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.365430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14f7c-bb36-4b77-978e-3cea59805e77 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.366196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14f7c-bb36-4b77-978e-3cea59805e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.366196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14f7c-bb36-4b77-978e-3cea59805e77 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.366823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14f7c-bb36-4b77-978e-3cea59805e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.367518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:12.369690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14f7c-bb36-4b77-978e-3cea59805e77 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.372913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386446c2-8ea8-41be-a332-31628e0f2c05 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.378925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad88dff-0947-42d0-9e00-e09479b914cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.379538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88dff-0947-42d0-9e00-e09479b914cc admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.379819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88dff-0947-42d0-9e00-e09479b914cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.380089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88dff-0947-42d0-9e00-e09479b914cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.380742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad88dff-0947-42d0-9e00-e09479b914cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.383050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad88dff-0947-42d0-9e00-e09479b914cc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.393540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 798/1611] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:12.394822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.395110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.395383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.416460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 814/1612] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:12.417847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889175ef-2965-42af-8968-c1f61fb6b3f3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.418135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889175ef-2965-42af-8968-c1f61fb6b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.418406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889175ef-2965-42af-8968-c1f61fb6b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.435871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:12.437305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-889175ef-2965-42af-8968-c1f61fb6b3f3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:12.437953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.438385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-889175ef-2965-42af-8968-c1f61fb6b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.450854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:12.501337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 815/1613] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.502707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0f41a-7476-49f8-ab3f-13db143a0b46 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.502996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0f41a-7476-49f8-ab3f-13db143a0b46 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.503267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0f41a-7476-49f8-ab3f-13db143a0b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.510566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 799/1614] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.511429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.523722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-fee0f41a-7476-49f8-ab3f-13db143a0b46 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:12.525030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fee0f41a-7476-49f8-ab3f-13db143a0b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.536066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 816/1615] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.536066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.536066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.536066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.556931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:12.558060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.565709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 817/1616] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:12.566494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.567255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a11103-6df1-430f-a6f6-6f18459d4bda None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.571606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.572230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.572512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.572817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.625724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df268111-2463-4f3a-892e-49b3cdedfb47 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.629352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.629963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.630247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.630519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.634010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.635457 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.640141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.641618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.644870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 800/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:12.645673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.651600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 818/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:12.652419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.656223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7d897-4de6-4862-b820-542eba769eb5 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.662103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.662301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ede479-4494-444c-b451-6f8b907d3c1e service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.663540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.663867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.664284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.664973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.666919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.667796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.668492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.668681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.669007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.669647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.671722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.682382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 801/1619] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:12.682382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.695642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a8807-0aa6-4d3c-86d6-885c643bf9de admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.698740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 819/1620] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:12 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:12.699709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.699845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.700380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.700666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.700974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.713468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.714982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.719283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba00a0c-85ee-4f26-a351-3b5ab9b0721e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.728186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 802/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:12.728934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.730204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.730910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.731194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.731469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.738720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e293b-fb65-4a32-b47b-d1390a1031ea service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.745549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.746971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.747589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.747735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.765791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.767790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.782007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 803/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:12.782981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.784348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:12.797232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815886f-3c4c-4c19-be0e-e80c227cbc52 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.800500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:12.803057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.804688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.806699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.807381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.813147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.815539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.821557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.824383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.828277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 820/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:12.829248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.843856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd18c2c-e661-4e38-9003-073d6b047799 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.850400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.851735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.852066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.852535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] PATH_INFO: `/v3/projects/ea14c355b7584e5bba0b22d2900c4d2f/users/e64d5434fbfa49e88e5a937e01372994/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.864142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 804/1624] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:12.865451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.886798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333df77-ffe0-415b-bd49-fd6393447f29 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:12.899915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:12.900593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:12.900953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:12.901228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:12.903369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.909088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea14c355b7584e5bba0b22d2900c4d2f, user_id=e64d5434fbfa49e88e5a937e01372994, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:12.909681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.918209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:12.942615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 805/1625] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:12.945807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.951405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 821/1626] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:12 2022] PUT /identity/v3/projects/ea14c355b7584e5bba0b22d2900c4d2f/users/e64d5434fbfa49e88e5a937e01372994/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:12.952513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:12.953680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:12.962966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a48aa-8b6c-4f66-9c7c-989193bec958 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.079546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef1d4a-49d1-4d9f-b560-bace6a261d0a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.089430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.090049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.090329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.090599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.091263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:13.097773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:13.128888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 822/1627] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:47:13.130544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:13.149575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf047-79b6-4871-afe4-9730dc9b95e8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.153064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.153867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.155130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.156146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] PATH_INFO: `/v3/projects/1fed5bbfdbff4dd680fe6d4600451c2b/users/ff1268f3b8a94754a0b4b9d0d0765399/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.160245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780351c2-2096-4e19-8f88-d46a339e03d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.161073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780351c2-2096-4e19-8f88-d46a339e03d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.161329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780351c2-2096-4e19-8f88-d46a339e03d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.161612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780351c2-2096-4e19-8f88-d46a339e03d7 admin admin] PATH_INFO: `/v3/projects/ea14c355b7584e5bba0b22d2900c4d2f/users/e64d5434fbfa49e88e5a937e01372994/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.173754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780351c2-2096-4e19-8f88-d46a339e03d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea14c355b7584e5bba0b22d2900c4d2f, user_id=e64d5434fbfa49e88e5a937e01372994, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:13.176514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780351c2-2096-4e19-8f88-d46a339e03d7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:13.197252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fed5bbfdbff4dd680fe6d4600451c2b, user_id=ff1268f3b8a94754a0b4b9d0d0765399, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:13.198761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 823/1628] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:13 2022] PUT /identity/v3/projects/ea14c355b7584e5bba0b22d2900c4d2f/users/e64d5434fbfa49e88e5a937e01372994/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:13.208211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:13.209368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.209656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.210524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.237451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 806/1629] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:12 2022] PUT /identity/v3/projects/1fed5bbfdbff4dd680fe6d4600451c2b/users/ff1268f3b8a94754a0b4b9d0d0765399/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:13.238865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:13.276564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] MFA Rules not processed for user `e64d5434fbfa49e88e5a937e01372994`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:13.277791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:13.413669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53141f6-98ba-4a4e-b571-d2bf2c95ab59 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.429618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.430345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.430773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.431378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.432210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:13.434148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:13.468402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 807/1630] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:13.469689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:13.491885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 824/1631] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:13.492471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1f0d0-4e48-42eb-b801-f6426200e7ca admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.507709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b690d-a397-44cf-ac9c-a8352a1539ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.508477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b690d-a397-44cf-ac9c-a8352a1539ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.508791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b690d-a397-44cf-ac9c-a8352a1539ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.509105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b690d-a397-44cf-ac9c-a8352a1539ab admin admin] PATH_INFO: `/v3/projects/1fed5bbfdbff4dd680fe6d4600451c2b/users/ff1268f3b8a94754a0b4b9d0d0765399/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.509776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:13.513227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b690d-a397-44cf-ac9c-a8352a1539ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fed5bbfdbff4dd680fe6d4600451c2b, user_id=ff1268f3b8a94754a0b4b9d0d0765399, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:13.518775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b690d-a397-44cf-ac9c-a8352a1539ab admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:13.542406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 808/1632] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:13 2022] PUT /identity/v3/projects/1fed5bbfdbff4dd680fe6d4600451c2b/users/ff1268f3b8a94754a0b4b9d0d0765399/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:13.542406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6467c0f-3f6d-450f-8d38-e2933665e512 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.542406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6467c0f-3f6d-450f-8d38-e2933665e512 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.542406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6467c0f-3f6d-450f-8d38-e2933665e512 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.548549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 809/1633] 10.222.0.45 () {54 vars in 912 bytes} [Tue Oct 4 08:47:13 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:13.550038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ed479-b3a4-4663-8ad3-56e38f6c048d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.550325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ed479-b3a4-4663-8ad3-56e38f6c048d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.550600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ed479-b3a4-4663-8ad3-56e38f6c048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.573025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:13.621399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a801a-fbe2-4fcf-a443-2786011d811d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.621627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-166ed479-b3a4-4663-8ad3-56e38f6c048d None None] MFA Rules not processed for user `ff1268f3b8a94754a0b4b9d0d0765399`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:13.622719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-166ed479-b3a4-4663-8ad3-56e38f6c048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:13.728886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.729890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.730457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.731553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.784494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:13.807863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 810/1634] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:13.814981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.816745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.817143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.862625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:13.864659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:13.890871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:13.892878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:13.909966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 825/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:13.930822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:13.951238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f313e3d-bb16-4a17-bb6d-ab22c60e592d service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:13.963778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:13.964506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.964752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.965016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:14.010074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:14.014029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:14.060562 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 811/1636] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:47:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:14.061499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 826/1637] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:14.120426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:14.139884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7721-5191-42b9-a1a9-2d1b4213c4b5 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:14.142222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:14.151782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:14.154193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:14.155402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:14.155833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:14.160079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60018f-cdcf-4c9e-9d23-dacec866764e service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:14.168887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12934a-16f4-43a9-8b2d-81ebad00365b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:14.169821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12934a-16f4-43a9-8b2d-81ebad00365b service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:14.170153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12934a-16f4-43a9-8b2d-81ebad00365b service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:14.170486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12934a-16f4-43a9-8b2d-81ebad00365b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:14.189029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:14.190994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:14.224602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 812/1638] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:14.252851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12934a-16f4-43a9-8b2d-81ebad00365b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:14.255785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12934a-16f4-43a9-8b2d-81ebad00365b service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:14.277506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 827/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:14.917701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:14.942183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474d04-4892-452b-871c-ff7130815f4c service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:14.953458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322d7b-1aaa-421c-8c31-25b84e582983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:14.954088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322d7b-1aaa-421c-8c31-25b84e582983 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:14.954655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322d7b-1aaa-421c-8c31-25b84e582983 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:14.954945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322d7b-1aaa-421c-8c31-25b84e582983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:15.130924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322d7b-1aaa-421c-8c31-25b84e582983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:15.133008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322d7b-1aaa-421c-8c31-25b84e582983 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:15.146335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 813/1640] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:15.500279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552828-3334-40cb-a329-fdd72ab5eda1 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:15.500926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552828-3334-40cb-a329-fdd72ab5eda1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:15.501054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba552828-3334-40cb-a329-fdd72ab5eda1 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:15.503816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 828/1641] 10.222.0.45 () {54 vars in 961 bytes} [Tue Oct 4 08:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:15.511075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f1ed-7353-4879-ae5c-7cea7a5c05ff None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:15.511992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f1ed-7353-4879-ae5c-7cea7a5c05ff None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:15.512300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f1ed-7353-4879-ae5c-7cea7a5c05ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:15.543131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7036f1ed-7353-4879-ae5c-7cea7a5c05ff None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:15.544683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7036f1ed-7353-4879-ae5c-7cea7a5c05ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:15.574390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 814/1642] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Oct 4 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:15.575564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d27ed-1bb5-479b-80c4-71383746df69 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:15.575861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d27ed-1bb5-479b-80c4-71383746df69 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:15.576652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d27ed-1bb5-479b-80c4-71383746df69 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:15.579389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 829/1643] 10.222.0.45 () {54 vars in 912 bytes} [Tue Oct 4 08:47:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:47:15.589173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:15.590415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:15.590415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:15.620412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:15.621948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:15.645940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 815/1644] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:15.660104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d27ed-1bb5-479b-80c4-71383746df69 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:15.678592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d27ed-1bb5-479b-80c4-71383746df69 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:15.683830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f5559-82b7-4c31-ae33-866e3546ce53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:15.684695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5559-82b7-4c31-ae33-866e3546ce53 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:15.685309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5559-82b7-4c31-ae33-866e3546ce53 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:15.685795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5559-82b7-4c31-ae33-866e3546ce53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:15.706984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f5559-82b7-4c31-ae33-866e3546ce53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:15.709073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f5559-82b7-4c31-ae33-866e3546ce53 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:15.739767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 830/1645] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:17.889836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:17.990941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:17.998628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e6c0-ec93-46cd-85e8-63bb64b1aef6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:18.005607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:18.005727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:18.005941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:18.006424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] PATH_INFO: `/v3/users/77a2d8ba621743bca39b7382fb8a9611` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:18.008850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a2d8ba621743bca39b7382fb8a9611)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:18.011056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:18.098133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a2d8ba621743bca39b7382fb8a9611'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.102892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a2d8ba621743bca39b7382fb8a9611'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.123447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a2d8ba621743bca39b7382fb8a9611'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.142824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a2d8ba621743bca39b7382fb8a9611'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.143773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a2d8ba621743bca39b7382fb8a9611'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.201730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:18.203016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:18.203560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:18.206713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 816/1646] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:17 2022] DELETE /identity/v3/users/77a2d8ba621743bca39b7382fb8a9611 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:18.251610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:18.257130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:18.276706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:18.378326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 831/1647] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:18.419202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:18.421125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:18.555528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:18.558678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:18.604551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdae554-e89b-4a6f-99dd-a692ca9cf523 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:18.618315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e59b-e765-4d92-810d-1ba5e24bf1a3 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:18.619245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:18.621342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:18.622427 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:18.623376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] PATH_INFO: `/v3/users/1c4a45eff71541539ca9064be4b90a2a` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:18.628277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4a45eff71541539ca9064be4b90a2a)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:18.634317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794603-291c-4fd4-bf30-c5c12930f0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:18.635052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: WARNING py.warnings [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:18.635052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: warnings.warn(msg) Oct 04 08:47:18.635052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: Oct 04 08:47:18.636347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794603-291c-4fd4-bf30-c5c12930f0fe service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:18.638272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794603-291c-4fd4-bf30-c5c12930f0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:18.639274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794603-291c-4fd4-bf30-c5c12930f0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:18.640441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:18.681263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794603-291c-4fd4-bf30-c5c12930f0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:18.688490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794603-291c-4fd4-bf30-c5c12930f0fe service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:18.772841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 817/1648] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:18.900382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4a45eff71541539ca9064be4b90a2a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.901195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4a45eff71541539ca9064be4b90a2a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.934204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4a45eff71541539ca9064be4b90a2a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.935202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4a45eff71541539ca9064be4b90a2a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:18.954291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4a45eff71541539ca9064be4b90a2a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:19.042124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 832/1649] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:18 2022] DELETE /identity/v3/users/1c4a45eff71541539ca9064be4b90a2a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:19.044274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:19.045480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:19.045919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:19.089657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:19.103700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:19.376460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 818/1650] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:19.398580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:19.400912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:19.561218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df812022-4afa-43d2-94c2-bbe68cdaad17 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:19.565870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:19.566836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:19.567285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:19.567836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:19.585580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:19.589496 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:19.611658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 833/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:21.321268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:21.323938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:21.351589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c426c4a-0245-4e32-b01a-c7ef1bd0592d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:21.370352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:21.371561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:21.374247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:21.375788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] PATH_INFO: `/v3/projects/c232aa58e8624eef92dfa84060b21f1e` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:21.382635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c232aa58e8624eef92dfa84060b21f1e)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:21.390353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: WARNING py.warnings [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:21.390353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: warnings.warn(msg) Oct 04 08:47:21.390353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: Oct 04 08:47:21.392071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:21.447768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:21.541371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c232aa58e8624eef92dfa84060b21f1e', 'request_id': 'req-e74d41f7-b321-4ad6-98e6-d1f434f89010'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.560212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c232aa58e8624eef92dfa84060b21f1e', 'request_id': 'req-e74d41f7-b321-4ad6-98e6-d1f434f89010'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.603643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c232aa58e8624eef92dfa84060b21f1e', 'request_id': 'req-e74d41f7-b321-4ad6-98e6-d1f434f89010'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.636867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] The token cache is being invalidate because project c232aa58e8624eef92dfa84060b21f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:21.637175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.639978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.645029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 819/1652] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:21 2022] DELETE /identity/v3/projects/c232aa58e8624eef92dfa84060b21f1e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:21.650785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:21.682702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe1fc-ebc5-4d49-b09a-01dd7fc4ad13 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:21.767731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:21.843403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:21.844119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:21.844338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:21.847497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] PATH_INFO: `/v3/users/e64d5434fbfa49e88e5a937e01372994` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:21.849633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64d5434fbfa49e88e5a937e01372994)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:21.856507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:21.970555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64d5434fbfa49e88e5a937e01372994'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.971985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64d5434fbfa49e88e5a937e01372994'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.991508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64d5434fbfa49e88e5a937e01372994'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:21.995850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64d5434fbfa49e88e5a937e01372994'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.015994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21164ea6-a9de-443c-b525-bee25dbe6fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64d5434fbfa49e88e5a937e01372994'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.055032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 834/1653] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:21 2022] DELETE /identity/v3/users/e64d5434fbfa49e88e5a937e01372994 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:22.332760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:22.337177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:22.372446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d41f7-b321-4ad6-98e6-d1f434f89010 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:22.525137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:22.531177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.531483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.531760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] PATH_INFO: `/v3/projects/462ebb2d073947f09aa29402780dedfa` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:22.533363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462ebb2d073947f09aa29402780dedfa)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:22.535804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:22.654811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462ebb2d073947f09aa29402780dedfa', 'request_id': 'req-c15b45dc-4339-4807-b402-29813a74eec3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.665925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462ebb2d073947f09aa29402780dedfa', 'request_id': 'req-c15b45dc-4339-4807-b402-29813a74eec3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.683410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462ebb2d073947f09aa29402780dedfa', 'request_id': 'req-c15b45dc-4339-4807-b402-29813a74eec3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.699291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] The token cache is being invalidate because project 462ebb2d073947f09aa29402780dedfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:22.702748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.702748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c15b45dc-4339-4807-b402-29813a74eec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:22.712030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 820/1654] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:22 2022] DELETE /identity/v3/projects/462ebb2d073947f09aa29402780dedfa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:22.714196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.714808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.714808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:22.749193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:22.750677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:22.977030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 835/1655] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:22.978801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.979009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.979288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.045696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:23.054239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:23.084384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 821/1656] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:23.090649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.109831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6c07-8dc0-4dd0-95d0-5da2a88a7d9f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.130067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.133260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.133600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.133883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.134583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:23.143784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.152451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.197214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.202818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 836/1657] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:23.215155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc26958-9f58-4826-a164-c2aaad7c39c1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.234357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.235049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.235778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.236496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.238298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.244823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.335079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 822/1658] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:23 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:47:23.341323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.360896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66dca5-acce-48ee-8f65-8609d2a04618 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.469030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:23.576264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.577170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.577646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.579027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.579840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.582359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.627721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 837/1659] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:23 2022] POST /identity/v3/users => generated 303 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:23.633287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.650970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:23.667561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfd25-0a7a-4959-aea8-7124c16defd8 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.722561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.724704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.729813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.732255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.734595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.747816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.779537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 823/1660] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:47:23.789124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.802241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91328205-71b4-45d3-8a5c-f8a82f5c0ff1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.826185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e446cf-1382-4d42-a971-05defd4272b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.829260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e446cf-1382-4d42-a971-05defd4272b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.831350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e446cf-1382-4d42-a971-05defd4272b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.833042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e446cf-1382-4d42-a971-05defd4272b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.833910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e446cf-1382-4d42-a971-05defd4272b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.845062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e446cf-1382-4d42-a971-05defd4272b3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.895067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 838/1661] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:47:23.900030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.911277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8299d-fc0d-4404-8edf-5224eb040174 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.917720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.918838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.919314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.919759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] PATH_INFO: `/v3/projects/12f8f2256a2d4465bb737a9e0727285a/users/3e5899732a534eb3a6b5d44cc12795ab/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.944689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f8f2256a2d4465bb737a9e0727285a, user_id=3e5899732a534eb3a6b5d44cc12795ab, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.948671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.972248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 824/1662] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:23 2022] PUT /identity/v3/projects/12f8f2256a2d4465bb737a9e0727285a/users/3e5899732a534eb3a6b5d44cc12795ab/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:23.984544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.985301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.986346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.045884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] MFA Rules not processed for user `3e5899732a534eb3a6b5d44cc12795ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:24.047726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.053666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:24.057829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.195146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 839/1663] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:24.196913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:24.200698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7ef15-1792-4bb2-a90f-9409044b0ec7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:24.212292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:24.212437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc498-ee83-461d-afff-4dec969ecf32 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:24.214708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.215529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.215989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] PATH_INFO: `/v3/users/76f505c66568429baf21e00d2af6ed75` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.221330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f505c66568429baf21e00d2af6ed75)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:24.223943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:24.224487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:24.225982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.226521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.227066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.228447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:24.230675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:24.278578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 840/1664] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:24 2022] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:24.301722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:24.310733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f505c66568429baf21e00d2af6ed75'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.311434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f505c66568429baf21e00d2af6ed75'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.332817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f505c66568429baf21e00d2af6ed75'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.347166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f505c66568429baf21e00d2af6ed75'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.348318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e553a1ba-2713-4f48-bc71-0547d5b1c273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f505c66568429baf21e00d2af6ed75'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.406234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 825/1665] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:24 2022] DELETE /identity/v3/users/76f505c66568429baf21e00d2af6ed75 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:24.408237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.408513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.408819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.449232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:24.450898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.455514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741ce8-284e-4575-9a1b-631063c88753 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:24.539858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:24.556514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:24.620745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 826/1666] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:24.621893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:24.623942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.626267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:24.627528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.629282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.630709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.632229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:24.637231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:24.655143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ed25d-21bb-4e35-a595-8e635a2a47f4 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:24.664192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:24.665316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.665702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.666330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] PATH_INFO: `/v3/projects/ea14c355b7584e5bba0b22d2900c4d2f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.669856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea14c355b7584e5bba0b22d2900c4d2f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:24.677655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:24.695760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 841/1667] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:24 2022] POST /identity/v3/users => generated 309 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:24.700030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:24.705493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.788563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea14c355b7584e5bba0b22d2900c4d2f', 'request_id': 'req-3654fdd6-4bde-4c8f-b18b-502698c1df0c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.802464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea14c355b7584e5bba0b22d2900c4d2f', 'request_id': 'req-3654fdd6-4bde-4c8f-b18b-502698c1df0c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.811406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea14c355b7584e5bba0b22d2900c4d2f', 'request_id': 'req-3654fdd6-4bde-4c8f-b18b-502698c1df0c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.830115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] The token cache is being invalidate because project ea14c355b7584e5bba0b22d2900c4d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:24.830676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.831554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:24.834327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 827/1668] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:24 2022] DELETE /identity/v3/projects/ea14c355b7584e5bba0b22d2900c4d2f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:24.839320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:24.839320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.848710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f245-6480-4e0f-a43e-5c738f78c4fe admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:24.932583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:24.933438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.933984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.934419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.936938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:24.976550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654fdd6-4bde-4c8f-b18b-502698c1df0c admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:24.981701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821be0-1d94-4b23-8e95-176568027efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:24.982331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821be0-1d94-4b23-8e95-176568027efc admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:24.982610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821be0-1d94-4b23-8e95-176568027efc admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:24.982882 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821be0-1d94-4b23-8e95-176568027efc admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:24.983535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05821be0-1d94-4b23-8e95-176568027efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:24.985587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05821be0-1d94-4b23-8e95-176568027efc admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:25.002270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 828/1669] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:25.003450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dc3b-58fd-4eeb-8609-5c3ecc67ed22 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.003736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dc3b-58fd-4eeb-8609-5c3ecc67ed22 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.004007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dc3b-58fd-4eeb-8609-5c3ecc67ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.063352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3653dc3b-58fd-4eeb-8609-5c3ecc67ed22 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:25.065941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3653dc3b-58fd-4eeb-8609-5c3ecc67ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:25.097669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 829/1670] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:25.097669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.100851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.101355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.101925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:25.103487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:25.136090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 842/1671] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:25.136981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:25.158341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] MFA Rules not processed for user `f6f4f7ec5b174efb88287c751bd69365`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:25.159672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:25.160043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d4a4a-c6af-4e2e-942f-9395f4b009cd service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:25.174325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1eb6e-2edd-407a-ad18-8e69cc042d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:25.174973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1eb6e-2edd-407a-ad18-8e69cc042d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.175266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1eb6e-2edd-407a-ad18-8e69cc042d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.179477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1eb6e-2edd-407a-ad18-8e69cc042d54 admin admin] PATH_INFO: `/v3/projects/cba5d884057f4533afd8a17d2881b23d/users/18ea24dc8e90444da4a99b20feeeb0c4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.229621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1eb6e-2edd-407a-ad18-8e69cc042d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba5d884057f4533afd8a17d2881b23d, user_id=18ea24dc8e90444da4a99b20feeeb0c4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:25.236786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1eb6e-2edd-407a-ad18-8e69cc042d54 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:25.262994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:25.274606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:25.286083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 843/1672] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:25 2022] PUT /identity/v3/projects/cba5d884057f4533afd8a17d2881b23d/users/18ea24dc8e90444da4a99b20feeeb0c4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:25.290784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.293235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.294455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.341989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:25.342197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 830/1673] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:25.343113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:25.344026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:25.371460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1695e-d659-4586-9fdd-0a008eddf961 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:25.499035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:25.509137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.509577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.510434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.511504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:25.513704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:25.543635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 844/1674] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:25.544083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 831/1675] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:25.545402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:25.549990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:25.551621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:25.576249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef35b7-4a9c-4c16-bab2-a3eb230df509 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:25.593230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:25.593913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.594191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.594462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] PATH_INFO: `/v3/projects/cba5d884057f4533afd8a17d2881b23d/users/18ea24dc8e90444da4a99b20feeeb0c4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.598308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba5d884057f4533afd8a17d2881b23d, user_id=18ea24dc8e90444da4a99b20feeeb0c4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:25.612032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:25.644241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 832/1676] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:25 2022] PUT /identity/v3/projects/cba5d884057f4533afd8a17d2881b23d/users/18ea24dc8e90444da4a99b20feeeb0c4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:25.645770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:25.737864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8212-3115-4101-a211-b05f535d1b7f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:25.795427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbc5b1-2e61-437f-a304-ec8f79fb3273 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:25.811855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:25.812495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.812808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.813084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.814415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:25.814726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:25.816370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d690ed2-7ab4-4dbc-be82-717db02ac3fe admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:25.842247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 833/1677] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:25.844139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.844139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.844139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:25.907698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] MFA Rules not processed for user `18ea24dc8e90444da4a99b20feeeb0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:25.910720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:25.980926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:25.982413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:25.983355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:25.984528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.065935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:26.108299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:26.144508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 834/1678] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:26.145282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.148975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.153912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.158895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.183009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e27a54-2d2e-4700-93b7-e68229cfeb03 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:26.198339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:26.199183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.199440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.199723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] PATH_INFO: `/v3/users/932fd63e96654e9996b294b7e40e2001` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.204011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] RBAC: Authorizing `identity:delete_user(user_id=932fd63e96654e9996b294b7e40e2001)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.205978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.235036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 845/1679] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:26.237261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.258301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6ab6b-5309-42ed-859e-717c4ec90fbf service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:26.264756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:26.265779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.266292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.266779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.267614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.272967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.341774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 846/1680] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:26 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:26.342636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.347184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.365955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932fd63e96654e9996b294b7e40e2001'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:26.368273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932fd63e96654e9996b294b7e40e2001'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:26.386041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932fd63e96654e9996b294b7e40e2001'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:26.405528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932fd63e96654e9996b294b7e40e2001'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:26.406286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932fd63e96654e9996b294b7e40e2001'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:26.451066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 835/1681] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:26 2022] DELETE /identity/v3/users/932fd63e96654e9996b294b7e40e2001 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:26.452061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.454876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.516133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adafe0f-f23c-46f6-897c-a9c7d8b30ae9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:26.635479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:26.636316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.636435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.636636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.640255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.644276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5374a5-deb4-4227-90e9-859a7ce3510b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:26.657017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c394f-0ea3-44fd-a67d-4033cb980d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:26.658082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c394f-0ea3-44fd-a67d-4033cb980d27 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.658510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c394f-0ea3-44fd-a67d-4033cb980d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.658929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c394f-0ea3-44fd-a67d-4033cb980d27 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.659945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c394f-0ea3-44fd-a67d-4033cb980d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.663045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c394f-0ea3-44fd-a67d-4033cb980d27 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.708164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 836/1682] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:26 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:26.713295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.713589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.714317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.751250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:26.752512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.778669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 837/1683] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:26.779617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.781067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.811027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.812842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.814120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba6ae8-eed1-4013-975c-231f2be6ee7c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:26.827525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:26.828187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.828783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.828783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] PATH_INFO: `/v3/projects/13c9959d127a468385dc6aae67f543b1` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.832263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c9959d127a468385dc6aae67f543b1)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.833864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.841744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 847/1684] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:26 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:26.842313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.867107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3bd1-4c3c-484a-bcdc-0ebf1c4fcc80 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:26.893846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:26.894832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:26.895295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:26.895588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:26.896469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:26.898559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:26.938209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 848/1685] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:26.941490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:26.952184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:26.977605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:26.985522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:26.994309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c9959d127a468385dc6aae67f543b1', 'request_id': 'req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.015667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c9959d127a468385dc6aae67f543b1', 'request_id': 'req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.034110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c9959d127a468385dc6aae67f543b1', 'request_id': 'req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.089931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] The token cache is being invalidate because project 13c9959d127a468385dc6aae67f543b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:27.092447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.094983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.110580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 838/1686] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:26 2022] DELETE /identity/v3/projects/13c9959d127a468385dc6aae67f543b1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:27.111996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:27.122190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.163993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa414-5a5f-4e57-b11a-ed9ed6a74a66 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:27.319833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:27.320799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.321091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.321365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.330500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87835c7f-ac02-4cbb-b35b-3795b94c4bd2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:27.332461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.347728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:27.348436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.348740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.349040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.349751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:27.351461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:27.355884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:27.357373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:27.369740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 849/1687] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:27.370417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:27.371959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.385344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b2c22-510f-41f5-b1c3-7d75a10ba35b service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:27.389947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 839/1688] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:27.390839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:27.394815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:27.395536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.395989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.396271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] PATH_INFO: `/v3/users/ff1268f3b8a94754a0b4b9d0d0765399` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.398701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1268f3b8a94754a0b4b9d0d0765399)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:27.400937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:27.402608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.447895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02788-7fa4-4228-a749-58c32f683dae admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:27.476532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:27.477233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.477518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.477786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] PATH_INFO: `/v3/users/3e5899732a534eb3a6b5d44cc12795ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.480755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5899732a534eb3a6b5d44cc12795ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:27.483513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:27.505817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1268f3b8a94754a0b4b9d0d0765399'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.507338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1268f3b8a94754a0b4b9d0d0765399'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.538213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1268f3b8a94754a0b4b9d0d0765399'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.540524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1268f3b8a94754a0b4b9d0d0765399'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.556685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c4f237cd-4f3e-4993-b6e8-fb49bc8348a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1268f3b8a94754a0b4b9d0d0765399'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.624932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 850/1689] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:27 2022] DELETE /identity/v3/users/ff1268f3b8a94754a0b4b9d0d0765399 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:27.626482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574873-953b-48cd-8947-7d4c0a9cd243 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.626774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574873-953b-48cd-8947-7d4c0a9cd243 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.627050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88574873-953b-48cd-8947-7d4c0a9cd243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.641307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5899732a534eb3a6b5d44cc12795ab'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.645584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5899732a534eb3a6b5d44cc12795ab'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.671027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5899732a534eb3a6b5d44cc12795ab'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.685230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5899732a534eb3a6b5d44cc12795ab'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.686326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5899732a534eb3a6b5d44cc12795ab'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:27.692029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-88574873-953b-48cd-8947-7d4c0a9cd243 None None] MFA Rules not processed for user `52d860c3943a48c5b693994cb45815f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:27.694196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-88574873-953b-48cd-8947-7d4c0a9cd243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.730949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 840/1690] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:27 2022] DELETE /identity/v3/users/3e5899732a534eb3a6b5d44cc12795ab => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:27.735892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:27.738731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:27.749969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.813374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 851/1691] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:27.821305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.821305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.821305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.847694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:27.859748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.870414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:27.925584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139e5b-32d6-4b3a-9e26-c5a74d2f5ff7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:27.947609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:27.948359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:27.948471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:27.948879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] PATH_INFO: `/v3/projects/aa6a894171a04e5dac0ca70700b1a68d/users/bb905fb648a848c49332b43c8c1862e0/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:27.956472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 852/1692] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:27.957795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:27.962960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:27.980330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6a894171a04e5dac0ca70700b1a68d, user_id=bb905fb648a848c49332b43c8c1862e0, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:27.988395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:28.014226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 841/1693] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:27 2022] PUT /identity/v3/projects/aa6a894171a04e5dac0ca70700b1a68d/users/bb905fb648a848c49332b43c8c1862e0/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:28.023990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:28.026429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:28.153019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98f7bd-945f-467c-bd83-aa9ed37535df None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:28.172341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef79e49-1bb6-43b3-a9e1-42d2d664254e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:28.182310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1578b-af48-41fc-90bf-a973da61b22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:28.182516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1578b-af48-41fc-90bf-a973da61b22b service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:28.182677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1578b-af48-41fc-90bf-a973da61b22b service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:28.182949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1578b-af48-41fc-90bf-a973da61b22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:28.345038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:28.346815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:28.347100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:28.347376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:28.359697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:28.364360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1578b-af48-41fc-90bf-a973da61b22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:28.367859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1578b-af48-41fc-90bf-a973da61b22b service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:28.400324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 842/1694] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:28.402634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:28.402927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:28.404240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:28.481961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] MFA Rules not processed for user `bb905fb648a848c49332b43c8c1862e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:28.484690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:28.517567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:28.523390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:28.562906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 853/1695] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:28.633246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 843/1696] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:28.638175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:28.652323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57528ad-a1e8-4d00-ae03-e27d276d396b service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:28.668367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:28.671027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:28.671588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:28.672459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:28.675279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:28.680393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:28.757097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 854/1697] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:28 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:28.768673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:28.780313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:28.793791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc92b6b-abee-4cbb-b317-3daa8ff41d8c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:28.901506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:28.903359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:28.903778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:28.904152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:28.904956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:28.908616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:28.948023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:28.962228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 844/1698] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:28 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:28.965475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb57d-e23e-4b11-b3db-b6e525f30fc1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:28.972070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:28.972943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:28.973338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:28.973722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:28.974490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:28.977274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:28.996312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 855/1699] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:28.997822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:29.014405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76c5f-3cab-4a57-a305-4d056c71f56a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:29.023193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:29.024356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:29.024474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:29.024801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] PATH_INFO: `/v3/projects/51321a5bbdc34178b945aea6992e1914/users/bc539f74d3b44fe7937397edf7c66614/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:29.081376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51321a5bbdc34178b945aea6992e1914, user_id=bc539f74d3b44fe7937397edf7c66614, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:29.085562 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:29.115036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:29.115750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 845/1700] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:28 2022] PUT /identity/v3/projects/51321a5bbdc34178b945aea6992e1914/users/bc539f74d3b44fe7937397edf7c66614/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:29.131444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c471ce-41f1-4ef1-ac1d-9c223575a199 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:29.257621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:29.260565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:29.305050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:29.305892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:29.308702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:29.309172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:29.311044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:29.315674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:29.383139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 856/1701] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:29.384182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:29.437603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fed3d-32fc-428b-8121-ea550bf9363c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:29.454083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bbb72-79e8-4697-9b5a-ec9a82dd8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:29.454910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bbb72-79e8-4697-9b5a-ec9a82dd8a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:29.456140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bbb72-79e8-4697-9b5a-ec9a82dd8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:29.456140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bbb72-79e8-4697-9b5a-ec9a82dd8a95 admin admin] PATH_INFO: `/v3/projects/51321a5bbdc34178b945aea6992e1914/users/bc539f74d3b44fe7937397edf7c66614/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:29.461200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bbb72-79e8-4697-9b5a-ec9a82dd8a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51321a5bbdc34178b945aea6992e1914, user_id=bc539f74d3b44fe7937397edf7c66614, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:29.469498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bbb72-79e8-4697-9b5a-ec9a82dd8a95 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:29.527450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 857/1702] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:29 2022] PUT /identity/v3/projects/51321a5bbdc34178b945aea6992e1914/users/bc539f74d3b44fe7937397edf7c66614/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:29.539636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:29.539925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:29.540207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:29.543429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e632b9-cf08-4f81-9544-d5396d44673e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:29.642475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] MFA Rules not processed for user `bc539f74d3b44fe7937397edf7c66614`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:29.643727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:29.680265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:29.682262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:29.682682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:29.683115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] PATH_INFO: `/v3/projects/7dc9aa5aa61a4d72ada7082a0165a5b7` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:29.699069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc9aa5aa61a4d72ada7082a0165a5b7)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:29.710994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:29.751214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:29.786658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:29.809176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 858/1703] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:29.822416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:29.823959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:29.883958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc9aa5aa61a4d72ada7082a0165a5b7', 'request_id': 'req-c42a8f5f-75e2-4115-995b-b96aaf2887e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:29.896075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc9aa5aa61a4d72ada7082a0165a5b7', 'request_id': 'req-c42a8f5f-75e2-4115-995b-b96aaf2887e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:29.910233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc9aa5aa61a4d72ada7082a0165a5b7', 'request_id': 'req-c42a8f5f-75e2-4115-995b-b96aaf2887e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:29.945911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] The token cache is being invalidate because project 7dc9aa5aa61a4d72ada7082a0165a5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:29.947150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:29.948029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-c42a8f5f-75e2-4115-995b-b96aaf2887e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:29.956056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 846/1704] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:29 2022] DELETE /identity/v3/projects/7dc9aa5aa61a4d72ada7082a0165a5b7 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:29.966069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c1deb-4859-4ebf-93df-dbd21fabec7f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:29.966593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c1deb-4859-4ebf-93df-dbd21fabec7f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:29.967591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c1deb-4859-4ebf-93df-dbd21fabec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:29.968833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef541f0-76cc-4895-9563-b3c56d06e02b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:30.112296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-288c1deb-4859-4ebf-93df-dbd21fabec7f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:30.132293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-288c1deb-4859-4ebf-93df-dbd21fabec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:30.305778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:30.306884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:30.307351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:30.307746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:30.317908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:30.410606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 847/1705] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:30.426753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:30.427109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:30.427390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:30.481509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:30.482757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:30.508522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 848/1706] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:30.514325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:30.538340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8bab-76d1-4b1c-b681-0fe69db828cb None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:30.558017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:30.558836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:30.559124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:30.559401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:30.560215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:30.560525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:30.562186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:30.577763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:30.588120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:30.605870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 859/1707] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:30.613876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 849/1708] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:47:30.619977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:30.641189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904462-af4a-472f-b9e6-0e9d2a223213 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:30.652945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:30.653756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:30.654180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:30.654529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:30.656765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:30.661844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:30.707339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 860/1709] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:30 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:30.708023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:30.723520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca7532-ac97-4d8e-8bf3-05eb35fc387b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:30.827284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:30.828265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:30.828681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:30.829159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:30.829971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:30.832346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:30.892305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:30.903871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 850/1710] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:30 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:30.908088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:30.914639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:30.920333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59ca94-1749-4ee4-948b-94aaa1cabe07 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:30.941932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:30.944410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:30.949090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:30.949227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:30.956212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:30.964963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:30.974329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c245-90e0-499a-ae05-2119b48e30f5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:30.998872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:31.003907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:31.004221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:31.004523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] PATH_INFO: `/v3/projects/1fed5bbfdbff4dd680fe6d4600451c2b` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:31.009326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fed5bbfdbff4dd680fe6d4600451c2b)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:31.015952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 861/1711] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:31.019569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:31.024074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:31.058120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde6f32-82d9-4a68-8a02-e9f7c960254b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:31.062262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:31.083507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:31.084883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:31.084883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:31.084883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:31.085321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:31.087218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:31.149969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 862/1712] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:31.153222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fed5bbfdbff4dd680fe6d4600451c2b', 'request_id': 'req-64224e79-d8a3-48be-bd9c-7967934aa520'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.157127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:31.161216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:31.169388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fed5bbfdbff4dd680fe6d4600451c2b', 'request_id': 'req-64224e79-d8a3-48be-bd9c-7967934aa520'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.179969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fed5bbfdbff4dd680fe6d4600451c2b', 'request_id': 'req-64224e79-d8a3-48be-bd9c-7967934aa520'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.227088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f497c8-dedd-44b3-baa1-89ca8a7d2eed admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:31.244969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:31.252439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] The token cache is being invalidate because project 1fed5bbfdbff4dd680fe6d4600451c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:31.252770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.257169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.258823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 851/1713] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:30 2022] DELETE /identity/v3/projects/1fed5bbfdbff4dd680fe6d4600451c2b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:31.259847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:31.262936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:31.502914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64224e79-d8a3-48be-bd9c-7967934aa520 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:31.513334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf45a-d891-46f3-a9ce-665e16c19291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:31.514032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf45a-d891-46f3-a9ce-665e16c19291 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:31.514314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf45a-d891-46f3-a9ce-665e16c19291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:31.514591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf45a-d891-46f3-a9ce-665e16c19291 admin admin] PATH_INFO: `/v3/projects/9ef1f8e82a984757b31f72fe98f692cf/users/bc5c34e3968f406da67cc6bd5690aff0/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:31.560655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cf45a-d891-46f3-a9ce-665e16c19291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef1f8e82a984757b31f72fe98f692cf, user_id=bc5c34e3968f406da67cc6bd5690aff0, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:31.566340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cf45a-d891-46f3-a9ce-665e16c19291 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:31.598523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 852/1714] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:31 2022] PUT /identity/v3/projects/9ef1f8e82a984757b31f72fe98f692cf/users/bc5c34e3968f406da67cc6bd5690aff0/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:31.611075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:31.611748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:31.612026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:31.612329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] PATH_INFO: `/v3/projects/12f8f2256a2d4465bb737a9e0727285a` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:31.612492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:31.612780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:31.613163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:31.633591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f8f2256a2d4465bb737a9e0727285a)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:31.646870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:31.710106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:31.711785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:31.872833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f8f2256a2d4465bb737a9e0727285a', 'request_id': 'req-5b68552f-7158-435a-978d-1651c10f6826'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.890643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f8f2256a2d4465bb737a9e0727285a', 'request_id': 'req-5b68552f-7158-435a-978d-1651c10f6826'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.915596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f8f2256a2d4465bb737a9e0727285a', 'request_id': 'req-5b68552f-7158-435a-978d-1651c10f6826'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.956337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] The token cache is being invalidate because project 12f8f2256a2d4465bb737a9e0727285a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:31.957235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.958926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5b68552f-7158-435a-978d-1651c10f6826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:31.963043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 863/1715] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:31 2022] DELETE /identity/v3/projects/12f8f2256a2d4465bb737a9e0727285a => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:31.965216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1cf3e-1795-4231-81f0-1f4c59203ffb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:31.966149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1cf3e-1795-4231-81f0-1f4c59203ffb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:31.966805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1cf3e-1795-4231-81f0-1f4c59203ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.007068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 853/1716] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:32.007068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.017626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.020385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-fec1cf3e-1795-4231-81f0-1f4c59203ffb None None] MFA Rules not processed for user `bc5c34e3968f406da67cc6bd5690aff0`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:32.022754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fec1cf3e-1795-4231-81f0-1f4c59203ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.052881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c657f0-2431-464e-b5e8-511ded6d4df8 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:32.098598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:32.194950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:32.195610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.195888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.196164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] PATH_INFO: `/v3/users/18ea24dc8e90444da4a99b20feeeb0c4` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.197370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ea24dc8e90444da4a99b20feeeb0c4)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:32.198946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 864/1717] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:32.200524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.200852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.201127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.203459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:32.227222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:32.228681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.245326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 865/1718] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:32.246463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.247707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.277497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3253cd-eb11-4dd5-aed5-93d16402f582 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:32.288039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b30f4-0471-4fef-a5b7-d27c0338de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:32.288692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b30f4-0471-4fef-a5b7-d27c0338de46 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.289051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b30f4-0471-4fef-a5b7-d27c0338de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.289382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b30f4-0471-4fef-a5b7-d27c0338de46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.299881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ea24dc8e90444da4a99b20feeeb0c4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:32.300561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ea24dc8e90444da4a99b20feeeb0c4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:32.306479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b30f4-0471-4fef-a5b7-d27c0338de46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:32.308803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b30f4-0471-4fef-a5b7-d27c0338de46 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:32.315646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ea24dc8e90444da4a99b20feeeb0c4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:32.331541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ea24dc8e90444da4a99b20feeeb0c4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:32.332176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ea24dc8e90444da4a99b20feeeb0c4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:32.362273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:32.366542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 854/1719] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:31 2022] DELETE /identity/v3/users/18ea24dc8e90444da4a99b20feeeb0c4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:32.372381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.382079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.388451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 866/1720] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:32.395371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.395772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.396416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.447037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] MFA Rules not processed for user `2dfb260d28124123a245c857da7e0279`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:32.448502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.542953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3d76-4510-470c-9810-1af078baaf0d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:32.569222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 867/1721] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:32.571360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.573455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.656624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:32.683529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:32.684162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.684446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.684751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.686787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:32.687144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:32.692132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d109-f185-4826-8b00-cef983651476 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:32.692611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef96960-b08f-48de-9dc3-66594ffe840a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:32.697292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:32.697568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.698094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.698199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.699695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:32.702257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:32.719674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 855/1722] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:32.721450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.721763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.722001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.743951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 868/1723] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:32.753241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.769216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] MFA Rules not processed for user `2dfb260d28124123a245c857da7e0279`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:32.770078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.780224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57be58-4fc5-4818-81be-6b54ea00242a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:32.783925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 856/1724] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:32.785420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.811234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6cb9e-d42d-490b-8241-697291974116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:32.812402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6cb9e-d42d-490b-8241-697291974116 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.812402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6cb9e-d42d-490b-8241-697291974116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.812565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447f95-1adf-444b-b889-aea3a1536007 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:32.812636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6cb9e-d42d-490b-8241-697291974116 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.813965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6cb9e-d42d-490b-8241-697291974116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:32.815867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6cb9e-d42d-490b-8241-697291974116 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:32.829653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:32.829653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.829653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.829653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.829945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:32.837378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:32.856529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 857/1725] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:32.856529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:32.861509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:32.876155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 869/1726] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:32.881133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:32.882756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:32.882756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:32.963170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] MFA Rules not processed for user `0817f0d1febd445e8aeb0e897076f533`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:32.964652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:33.026050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18e08-fc30-4cb1-8085-cd063ef1ae50 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:33.057636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:33.148977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 870/1727] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:33.150325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.233659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4510-0bc7-4b37-893d-abb16247fb66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:33.234792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4510-0bc7-4b37-893d-abb16247fb66 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.234792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4510-0bc7-4b37-893d-abb16247fb66 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.235157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4510-0bc7-4b37-893d-abb16247fb66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.300027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b38021-9370-4ab8-9795-26f0faf229c3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:33.316855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:33.317854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.317854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.318062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] PATH_INFO: `/v3/projects/e274e0c7f5ca4b7e9c5f0214f09b84ed/users/237da69d24474006b1091c94be817f56/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.350812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e274e0c7f5ca4b7e9c5f0214f09b84ed, user_id=237da69d24474006b1091c94be817f56, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:33.353535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:33.362325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4510-0bc7-4b37-893d-abb16247fb66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:33.364167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4510-0bc7-4b37-893d-abb16247fb66 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:33.397909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 871/1728] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:33 2022] PUT /identity/v3/projects/e274e0c7f5ca4b7e9c5f0214f09b84ed/users/237da69d24474006b1091c94be817f56/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:33.397909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.398884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:33.430782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 858/1729] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:33.434782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.435026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.445519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.493930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] MFA Rules not processed for user `0817f0d1febd445e8aeb0e897076f533`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:33.495366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:33.544994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313cd7-8f8b-4239-bb94-4e4d5436c5dd admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:33.552170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:33.552492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.554715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.555092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.556380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:33.566461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:33.643052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 872/1730] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:33 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:33.643052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.646391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:33.661438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 859/1731] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:33.664020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.695338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243510c3-6200-419c-ba1f-6be14b216a7f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:33.702126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf187fc-f87c-47d7-8a84-b13a58a4bde1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:33.717386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:33.717386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.717857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.718262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] PATH_INFO: `/v3/projects/cba5d884057f4533afd8a17d2881b23d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.719849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba5d884057f4533afd8a17d2881b23d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:33.720243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:33.721648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.723467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:33.723961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.724271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.733348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:33.735018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:33.760461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 860/1732] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:33.761362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.779713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146558-63ea-4586-984d-55642c587a54 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:33.797537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:33.798177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:33.798459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:33.798738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:33.799394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:33.801076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:33.825773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 861/1733] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:33.826715 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.829759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:33.860020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba5d884057f4533afd8a17d2881b23d', 'request_id': 'req-c346e84b-0dca-4318-824d-2373d8642077'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:33.864498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:33.875743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba5d884057f4533afd8a17d2881b23d', 'request_id': 'req-c346e84b-0dca-4318-824d-2373d8642077'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:33.892795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba5d884057f4533afd8a17d2881b23d', 'request_id': 'req-c346e84b-0dca-4318-824d-2373d8642077'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:33.919410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] The token cache is being invalidate because project cba5d884057f4533afd8a17d2881b23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:33.919705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:33.920407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:33.927046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 873/1734] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:33 2022] DELETE /identity/v3/projects/cba5d884057f4533afd8a17d2881b23d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:33.928600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:33.933068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:33.973936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033d1-2ee4-4a28-b00e-0d7dcf2ef002 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:34.044962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346e84b-0dca-4318-824d-2373d8642077 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:34.053774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:34.054476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.055024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.055471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] PATH_INFO: `/v3/projects/e274e0c7f5ca4b7e9c5f0214f09b84ed/users/237da69d24474006b1091c94be817f56/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.057454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e274e0c7f5ca4b7e9c5f0214f09b84ed, user_id=237da69d24474006b1091c94be817f56, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:34.060972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:34.063488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:34.064851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.065276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.065868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.068630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.079742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 874/1735] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:33 2022] PUT /identity/v3/projects/e274e0c7f5ca4b7e9c5f0214f09b84ed/users/237da69d24474006b1091c94be817f56/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:34.081004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:34.082709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.100236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:34.176757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:34.179344 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7115ccf-2ab3-4d13-8b1b-5aab1da24739 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:34.202581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 862/1736] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:34.206318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d238c8c-4615-42f1-a03d-4f84999bb056 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.207878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d238c8c-4615-42f1-a03d-4f84999bb056 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.208314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d238c8c-4615-42f1-a03d-4f84999bb056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.212161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad69d-e596-4be2-b2a8-295dfca422c9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:34.221451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834fa9-524b-4c5f-8737-a58ea816fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:34.222340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834fa9-524b-4c5f-8737-a58ea816fb20 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.223140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834fa9-524b-4c5f-8737-a58ea816fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.223565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834fa9-524b-4c5f-8737-a58ea816fb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.225288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834fa9-524b-4c5f-8737-a58ea816fb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:34.227371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834fa9-524b-4c5f-8737-a58ea816fb20 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:34.242666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 875/1737] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:34.244385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94d6a-6fcd-4b3e-a684-1587d7bad812 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.244883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94d6a-6fcd-4b3e-a684-1587d7bad812 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.245332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc94d6a-6fcd-4b3e-a684-1587d7bad812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.261799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5d238c8c-4615-42f1-a03d-4f84999bb056 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:34.263057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5d238c8c-4615-42f1-a03d-4f84999bb056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.294730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 863/1738] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:34.298480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.298769 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.299053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.307517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-5dc94d6a-6fcd-4b3e-a684-1587d7bad812 None None] MFA Rules not processed for user `237da69d24474006b1091c94be817f56`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:34.308782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5dc94d6a-6fcd-4b3e-a684-1587d7bad812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.354335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] MFA Rules not processed for user `f6f4f7ec5b174efb88287c751bd69365`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:34.363910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.452243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 864/1739] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:34.457442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:34.470048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:34.487376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523298e-6979-426f-a8b1-01bf8d80fe38 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:34.506704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 876/1740] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:34.510874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.516457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.518345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.521090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:34.521871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.522155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.522435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] PATH_INFO: `/v3/projects/e19fba7974014deaa9310505791b260d/users/92b13c310477400ba40026c2c9a1a7b4/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.565402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19fba7974014deaa9310505791b260d, user_id=92b13c310477400ba40026c2c9a1a7b4, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:34.568600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:34.586964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:34.589177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.594961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 865/1741] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:34 2022] PUT /identity/v3/projects/e19fba7974014deaa9310505791b260d/users/92b13c310477400ba40026c2c9a1a7b4/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:34.596356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:34.606829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.733894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca558ac-b076-43da-8360-311779295a32 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:34.738048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:34.738895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.739254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.739597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.742533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.758973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 877/1742] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:34.760679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:34.763034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.788977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ff0f0-9dc9-4e29-a568-9a64254038f7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:34.794367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:34.795206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.795574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.795942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.800905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:34.858547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:34.880469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:34.883092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6c8e-42e3-4939-b2d7-41a38254ea20 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:34.914523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 866/1743] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:34.916287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6e7d-37a8-4cbc-b69c-9d7fa6863cb8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:34.920299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6e7d-37a8-4cbc-b69c-9d7fa6863cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:34.925768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6e7d-37a8-4cbc-b69c-9d7fa6863cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:34.967010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:34.968452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:34.996748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 878/1744] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:34.999327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.023962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c545-981f-43f2-8ed5-693ff74f4e1a service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.033462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e30e6e7d-37a8-4cbc-b69c-9d7fa6863cb8 None None] MFA Rules not processed for user `92b13c310477400ba40026c2c9a1a7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:35.034912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e30e6e7d-37a8-4cbc-b69c-9d7fa6863cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:35.051953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.052602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.060693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.061257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.063323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:35.069022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.070793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff44be7-12da-462b-9d14-d64194501d47 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.126395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 879/1745] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:35.127919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c301fd-f0b8-41a4-940c-b5c0c44aa255 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.132416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c301fd-f0b8-41a4-940c-b5c0c44aa255 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.134097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c301fd-f0b8-41a4-940c-b5c0c44aa255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.214463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-30c301fd-f0b8-41a4-940c-b5c0c44aa255 None None] MFA Rules not processed for user `52d860c3943a48c5b693994cb45815f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:35.216289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-30c301fd-f0b8-41a4-940c-b5c0c44aa255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:35.348015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 867/1746] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:35.350684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc37c1-5df2-4240-a593-5e4acc9b9189 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.351285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc37c1-5df2-4240-a593-5e4acc9b9189 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.351570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc37c1-5df2-4240-a593-5e4acc9b9189 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.353806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 868/1747] 10.222.0.45 () {54 vars in 912 bytes} [Tue Oct 4 08:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:35.354560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc37c1-5df2-4240-a593-5e4acc9b9189 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.387755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 880/1748] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:35.387755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2f0f-a5ae-47b4-a52c-1491d0235c6c None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.387755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2f0f-a5ae-47b4-a52c-1491d0235c6c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.387755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2f0f-a5ae-47b4-a52c-1491d0235c6c None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.398732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 881/1749] 10.222.0.45 () {54 vars in 912 bytes} [Tue Oct 4 08:47:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:35.399732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc37c1-5df2-4240-a593-5e4acc9b9189 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.401115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2f0f-a5ae-47b4-a52c-1491d0235c6c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.412276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c638-2d95-41a0-998f-3201e7187af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.413303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c638-2d95-41a0-998f-3201e7187af6 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.413780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c638-2d95-41a0-998f-3201e7187af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.414240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c638-2d95-41a0-998f-3201e7187af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.415096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c638-2d95-41a0-998f-3201e7187af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.423248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c638-2d95-41a0-998f-3201e7187af6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.434157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2f0f-a5ae-47b4-a52c-1491d0235c6c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.450894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38218b-f40f-4f15-9a51-4fbcfd9983a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.453138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38218b-f40f-4f15-9a51-4fbcfd9983a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.453459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38218b-f40f-4f15-9a51-4fbcfd9983a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.453738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38218b-f40f-4f15-9a51-4fbcfd9983a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.457393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38218b-f40f-4f15-9a51-4fbcfd9983a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.464494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38218b-f40f-4f15-9a51-4fbcfd9983a0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.495359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 869/1750] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:35.501156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.502448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.502792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.531271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:35.550424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 882/1751] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:35.552498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.557716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.558040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.635044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:35.636370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:35.639802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:35.645583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:35.768543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 870/1752] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:35.769349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.781864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 883/1753] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:35.783743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.860255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:35.880904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6f6d-75d6-40ad-9b69-111432417772 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.886166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.886856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.887144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.887420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.888064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.890118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.895117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4191cbf-8858-4ce1-8e9a-fb71ee82fd62 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.901782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.902868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.903599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.903891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.904987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.906955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.918039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 871/1754] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:35.919896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.922152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:35.937867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4ee46-ca7a-4423-8a35-38602aa4efe1 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.941370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 884/1755] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:35 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:35.941370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.941900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.942791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.943313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.943668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.946186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:35.951950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.953708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.961204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ae3c2-9a6a-4179-b9bc-3c7ad9848db5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.963155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 872/1756] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:35.964276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:35.965910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.966535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.966822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.967137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.977180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.978796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.979248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d78c-0c02-4138-a6b0-e2fe214d6426 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:35.986571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:35.987253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:35.987906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:35.987906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:35.988571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:35.990835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:35.991104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 885/1757] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:35.994916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.011822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 873/1758] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:36.015714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.020618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288922d-d3f5-462c-97b5-1f114f7c8cb5 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.030581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.031201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.031482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.032966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.033638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.038657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.039818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6afda-eaaa-46c4-9ca3-982b417fb3f1 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.050088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.052234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.052600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.054556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.056156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.058863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.072466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 886/1759] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:36.074708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.088618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 874/1760] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:36.091660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.094141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2949b-e943-468f-8605-d83ebf94949b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.100961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.101757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.102106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.102457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] PATH_INFO: `/v3/projects/b84140bdde034d06901064b73c8bfa21/users/74a2386f3557459f919411ecad891438/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.120526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383a0c0-e6ba-442e-a731-9b9ddf45750e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.136815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede4a4e-ce80-4bdf-a3e8-362c92583604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.137294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84140bdde034d06901064b73c8bfa21, user_id=74a2386f3557459f919411ecad891438, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.139836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede4a4e-ce80-4bdf-a3e8-362c92583604 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.140123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede4a4e-ce80-4bdf-a3e8-362c92583604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.140400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede4a4e-ce80-4bdf-a3e8-362c92583604 admin admin] PATH_INFO: `/v3/projects/fa98adb5889e486caedf13b039f4f920/users/c0b36791891b44939bea19d8594fc4f4/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.141409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.180949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 887/1761] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:36 2022] PUT /identity/v3/projects/b84140bdde034d06901064b73c8bfa21/users/74a2386f3557459f919411ecad891438/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:36.182246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.186657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede4a4e-ce80-4bdf-a3e8-362c92583604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa98adb5889e486caedf13b039f4f920, user_id=c0b36791891b44939bea19d8594fc4f4, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.193027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede4a4e-ce80-4bdf-a3e8-362c92583604 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.239996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 875/1762] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:36 2022] PUT /identity/v3/projects/fa98adb5889e486caedf13b039f4f920/users/c0b36791891b44939bea19d8594fc4f4/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:36.244646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.244944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.245162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.262521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:36.277949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eda772-9caf-4cd2-8bed-35ed80ebfbab admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.321948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] MFA Rules not processed for user `c0b36791891b44939bea19d8594fc4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:36.326129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:36.354965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.355210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.355305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.355570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.356219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.358154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.374754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 888/1763] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:36.375534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.392404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d429e-2aad-434a-8f28-c15845252b4d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.419164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebb07b-6aaa-4481-a86e-53c6438ec144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.420647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebb07b-6aaa-4481-a86e-53c6438ec144 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.420978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebb07b-6aaa-4481-a86e-53c6438ec144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.421426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebb07b-6aaa-4481-a86e-53c6438ec144 admin admin] PATH_INFO: `/v3/projects/b84140bdde034d06901064b73c8bfa21/users/74a2386f3557459f919411ecad891438/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.426168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebb07b-6aaa-4481-a86e-53c6438ec144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84140bdde034d06901064b73c8bfa21, user_id=74a2386f3557459f919411ecad891438, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.434396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebb07b-6aaa-4481-a86e-53c6438ec144 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.469023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 889/1764] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:36 2022] PUT /identity/v3/projects/b84140bdde034d06901064b73c8bfa21/users/74a2386f3557459f919411ecad891438/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:36.470552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.471109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.471447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.504999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] MFA Rules not processed for user `74a2386f3557459f919411ecad891438`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:36.507380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:36.510739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 876/1765] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:36.515431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.544526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99cf22-d39f-4a45-a98d-b45c23311c3e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.691478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 890/1766] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:36.704374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.765086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.765716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.765996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.766269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:36.766913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:36.770860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:36.815335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:36.836820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 877/1767] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:36 2022] POST /identity/v3/projects => generated 373 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:36.837844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:36.853732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:36.900772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c091a-8add-4497-a792-55af00b547f9 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:36.934953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:36.981693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2bda7-7154-44a7-8996-44f638d80528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:36.982499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2bda7-7154-44a7-8996-44f638d80528 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:36.982913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2bda7-7154-44a7-8996-44f638d80528 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:36.984010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2bda7-7154-44a7-8996-44f638d80528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.044152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78bb22-cb82-4f5c-bda0-f938fe5dab11 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.054124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.054921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.055308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.055685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.058951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:37.075408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.077483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.099649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 878/1768] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:37.100602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:37.130310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2bda7-7154-44a7-8996-44f638d80528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.133377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2bda7-7154-44a7-8996-44f638d80528 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.159415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 891/1769] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:37.160803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176cb9d-0740-4353-8c0c-299b52b29e22 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.161584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176cb9d-0740-4353-8c0c-299b52b29e22 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.161881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176cb9d-0740-4353-8c0c-299b52b29e22 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.163378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 892/1770] 10.222.0.45 () {54 vars in 961 bytes} [Tue Oct 4 08:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:37.164135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176cb9d-0740-4353-8c0c-299b52b29e22 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:37.194827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176cb9d-0740-4353-8c0c-299b52b29e22 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.204570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.205670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.205948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.206221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.258076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed05673-242f-4abc-94ca-dd8df54a5736 service placement] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.276391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a95c4-1141-493d-9a8a-859554a816f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.277055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a95c4-1141-493d-9a8a-859554a816f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.277334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a95c4-1141-493d-9a8a-859554a816f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.277604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a95c4-1141-493d-9a8a-859554a816f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.278247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a95c4-1141-493d-9a8a-859554a816f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.280182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a95c4-1141-493d-9a8a-859554a816f0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.355564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 879/1771] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:37 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:37.357025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15523504-d299-4879-b317-294057e6f9a8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.357312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15523504-d299-4879-b317-294057e6f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.357595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15523504-d299-4879-b317-294057e6f9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.405713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-15523504-d299-4879-b317-294057e6f9a8 None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:37.406999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-15523504-d299-4879-b317-294057e6f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:37.418083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.420179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.429902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 880/1772] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Oct 4 08:47:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:37.430656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15523504-d299-4879-b317-294057e6f9a8 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:37.447069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 893/1773] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:37.448029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:37.456150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15523504-d299-4879-b317-294057e6f9a8 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.469364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.469839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.470148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.470405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.471296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.473335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.478530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102798a-63f7-45b6-bda4-252aa598ff67 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.487555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.488311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.488593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.488890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.501829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.507506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.508910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 881/1774] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:37.513102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:37.546857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74d4f-2a19-429b-b24b-2568462825de admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.558747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 894/1775] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:37.571232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.573881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.574174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.574454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] PATH_INFO: `/v3/projects/97b71cb48ed14a5f97c597d9e97582d7/users/ddc66a910e824383bf8382da2caaa5bc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.639122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b71cb48ed14a5f97c597d9e97582d7, user_id=ddc66a910e824383bf8382da2caaa5bc, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.654592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:37.734515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 882/1776] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:37 2022] PUT /identity/v3/projects/97b71cb48ed14a5f97c597d9e97582d7/users/ddc66a910e824383bf8382da2caaa5bc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:37.738602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:37.756038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4915c-75ba-4771-bba7-e56b95df3e39 service placement] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:37.933740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:37.969929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6664e-f85f-490a-9b81-81a92c371d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:37.975896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6664e-f85f-490a-9b81-81a92c371d88 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:37.976398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6664e-f85f-490a-9b81-81a92c371d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:37.978430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6664e-f85f-490a-9b81-81a92c371d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:37.981007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6664e-f85f-490a-9b81-81a92c371d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:37.989304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6664e-f85f-490a-9b81-81a92c371d88 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:38.029498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 895/1777] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:38.033829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:38.050612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b09a31-753f-46fb-9019-bd746f4fd88a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:38.083509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:38.084999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:38.085423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:38.085848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] PATH_INFO: `/v3/projects/97b71cb48ed14a5f97c597d9e97582d7/users/ddc66a910e824383bf8382da2caaa5bc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:38.090596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b71cb48ed14a5f97c597d9e97582d7, user_id=ddc66a910e824383bf8382da2caaa5bc, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:38.093683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:38.137211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 883/1778] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:38 2022] PUT /identity/v3/projects/97b71cb48ed14a5f97c597d9e97582d7/users/ddc66a910e824383bf8382da2caaa5bc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:38.139483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bec5d6-e262-47e3-8fe1-2f27d5a3388e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:38.139767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bec5d6-e262-47e3-8fe1-2f27d5a3388e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:38.140480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bec5d6-e262-47e3-8fe1-2f27d5a3388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:38.197281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-96bec5d6-e262-47e3-8fe1-2f27d5a3388e None None] MFA Rules not processed for user `ddc66a910e824383bf8382da2caaa5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:38.202837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-96bec5d6-e262-47e3-8fe1-2f27d5a3388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:38.408836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 896/1779] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:38.494006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:38.584431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:38.818664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e68a-77fe-4226-a718-5fd2f1f555f5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:38.840074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:38.841171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:38.841687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:38.842164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:38.907880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:38.910719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:38.916338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:38.916627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:38.916953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:38.966712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 884/1780] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:38.978746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] MFA Rules not processed for user `0817f0d1febd445e8aeb0e897076f533`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:38.987309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:39.226885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 897/1781] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:39.388465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:39.398574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b872588-c32a-4ded-9d3b-dbd2f640105d service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:39.403938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9b8fc-98ca-4703-9dd9-811402b0be47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:39.404965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b8fc-98ca-4703-9dd9-811402b0be47 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:39.405406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b8fc-98ca-4703-9dd9-811402b0be47 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:39.405840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9b8fc-98ca-4703-9dd9-811402b0be47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:39.532444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9b8fc-98ca-4703-9dd9-811402b0be47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:39.541497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9b8fc-98ca-4703-9dd9-811402b0be47 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:39.573864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 885/1782] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:41.546477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:41.765056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979602-0a85-4fa4-9528-f0b1fd265d00 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:41.785575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:41.787409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:41.787870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:41.788295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] PATH_INFO: `/v3/users/bc5c34e3968f406da67cc6bd5690aff0` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:41.791431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5c34e3968f406da67cc6bd5690aff0)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:41.793586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:41.878859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:41.949315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5c34e3968f406da67cc6bd5690aff0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:41.956592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5c34e3968f406da67cc6bd5690aff0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:42.017844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5c34e3968f406da67cc6bd5690aff0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:42.020904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5c34e3968f406da67cc6bd5690aff0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:42.028293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:42.029314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:42.029802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:42.053200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26cedf58-1d47-4ec9-bfd6-d0abe21d6c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5c34e3968f406da67cc6bd5690aff0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:42.127331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 898/1783] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:41 2022] DELETE /identity/v3/users/bc5c34e3968f406da67cc6bd5690aff0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:42.131788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:42.132302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:42.132745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:42.176193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:42.177918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:42.245294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:42.246603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:42.442835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 899/1784] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:42.502802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:42.506120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:42.669558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 886/1785] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 642 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 04 08:47:42.759309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273d32c-9778-4a0a-bfa5-4987ff680271 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:42.766498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:42.769458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:42.769906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:42.770324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:42.786583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:42.788516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:42.808974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 900/1786] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:43.060477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:43.063663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:43.258104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:43.464849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91669-e127-4258-9160-9dcf0ef78495 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:43.486445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789da58b-b72c-4f9c-952b-bb92fe1b44ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:43.489307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789da58b-b72c-4f9c-952b-bb92fe1b44ae service swift] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:43.491097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789da58b-b72c-4f9c-952b-bb92fe1b44ae service swift] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:43.492828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789da58b-b72c-4f9c-952b-bb92fe1b44ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:43.518314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789da58b-b72c-4f9c-952b-bb92fe1b44ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:43.524324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789da58b-b72c-4f9c-952b-bb92fe1b44ae service swift] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:43.587366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 887/1787] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:47:44.025328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:44.026866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:44.055663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d85b8-c462-41fd-8f27-5f007f872739 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:44.070194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:44.071411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:44.074294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:44.075293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] PATH_INFO: `/v3/users/92b13c310477400ba40026c2c9a1a7b4` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:44.078335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b13c310477400ba40026c2c9a1a7b4)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:44.085804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:44.233919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:44.276210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b13c310477400ba40026c2c9a1a7b4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:44.277014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b13c310477400ba40026c2c9a1a7b4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:44.304219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b13c310477400ba40026c2c9a1a7b4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:44.305846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b13c310477400ba40026c2c9a1a7b4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:44.320829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b13c310477400ba40026c2c9a1a7b4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:44.382507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 901/1788] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:44 2022] DELETE /identity/v3/users/92b13c310477400ba40026c2c9a1a7b4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:44.388129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d304f-b60e-4fa1-9d9c-410b8e7ac1d0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:44.389128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d304f-b60e-4fa1-9d9c-410b8e7ac1d0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:44.389565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d304f-b60e-4fa1-9d9c-410b8e7ac1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:44.440333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5c3d304f-b60e-4fa1-9d9c-410b8e7ac1d0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:44.442179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5c3d304f-b60e-4fa1-9d9c-410b8e7ac1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:44.734387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 888/1789] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:44.956904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:44.959428 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:45.167320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:45.167972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:45.168590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:45.244641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:45.250015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:45.299831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d6a0-54e3-4a20-b814-ae62bd7c4b49 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:45.310184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:45.310831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:45.311118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:45.311553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:45.335755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:45.338917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:45.378085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 902/1790] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:45.506858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 889/1791] 10.222.0.13 () {58 vars in 1015 bytes} [Tue Oct 4 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:45.979949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:45.998880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2de40-6b78-4d6a-bbfa-044c3acd22aa service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:46.026275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:46.027694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:46.028172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:46.028634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:46.047747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:46.052154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:46.056771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:46.058581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:46.076594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 903/1792] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:46.084471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74534f-b78c-4d8d-a17d-0ef8659b3a87 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:46.097438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:46.100608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:46.101047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:46.101574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:46.149674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:46.152438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:46.191687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 890/1793] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:48.163315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:48.164946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:48.207283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254f77-d040-4f20-a200-3e71eb8279af service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:48.224500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:48.226523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:48.227551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:48.227840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] PATH_INFO: `/v3/projects/9ef1f8e82a984757b31f72fe98f692cf` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:48.229888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef1f8e82a984757b31f72fe98f692cf)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:48.251849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:48.419054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef1f8e82a984757b31f72fe98f692cf', 'request_id': 'req-217e548a-08b3-4048-9403-de3571d3b44c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:48.436437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef1f8e82a984757b31f72fe98f692cf', 'request_id': 'req-217e548a-08b3-4048-9403-de3571d3b44c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:48.460057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef1f8e82a984757b31f72fe98f692cf', 'request_id': 'req-217e548a-08b3-4048-9403-de3571d3b44c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:48.484034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] The token cache is being invalidate because project 9ef1f8e82a984757b31f72fe98f692cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:48.484411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:48.486523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:48.493654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 904/1794] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:48 2022] DELETE /identity/v3/projects/9ef1f8e82a984757b31f72fe98f692cf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:48.494896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:48.542145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1385e-249a-414d-a611-d22f2fc7209c service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:48.675228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:48.732107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:48.733040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:48.733638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:48.736938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] PATH_INFO: `/v3/users/237da69d24474006b1091c94be817f56` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:48.738088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237da69d24474006b1091c94be817f56)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:48.760455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:49.008696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237da69d24474006b1091c94be817f56'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.010679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237da69d24474006b1091c94be817f56'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.027674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237da69d24474006b1091c94be817f56'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.044406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237da69d24474006b1091c94be817f56'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.045418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237da69d24474006b1091c94be817f56'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.094442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 891/1795] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:48 2022] DELETE /identity/v3/users/237da69d24474006b1091c94be817f56 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:49.372534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:49.375835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:49.406124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e548a-08b3-4048-9403-de3571d3b44c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:49.499233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:49.581012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:49.581945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:49.582403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:49.583068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] PATH_INFO: `/v3/projects/e19fba7974014deaa9310505791b260d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:49.584694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19fba7974014deaa9310505791b260d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:49.587940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:49.728600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19fba7974014deaa9310505791b260d', 'request_id': 'req-2bdf3842-e508-4177-8788-e6fa81e6f409'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.747088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19fba7974014deaa9310505791b260d', 'request_id': 'req-2bdf3842-e508-4177-8788-e6fa81e6f409'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.769811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19fba7974014deaa9310505791b260d', 'request_id': 'req-2bdf3842-e508-4177-8788-e6fa81e6f409'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.799862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] The token cache is being invalidate because project e19fba7974014deaa9310505791b260d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:49.800163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.800974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-2bdf3842-e508-4177-8788-e6fa81e6f409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:49.807680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 905/1796] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:49 2022] DELETE /identity/v3/projects/e19fba7974014deaa9310505791b260d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:49.809094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:49.810662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:49.866175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966736c-5dd8-4af4-9d79-cf76f6c8c3b1 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:50.278904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:50.281021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:50.281366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:50.282664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] PATH_INFO: `/v3/users/74a2386f3557459f919411ecad891438` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:50.285190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a2386f3557459f919411ecad891438)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:50.296489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:50.405770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a2386f3557459f919411ecad891438'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:50.416117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a2386f3557459f919411ecad891438'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:50.435001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a2386f3557459f919411ecad891438'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:50.443636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:50.450422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a2386f3557459f919411ecad891438'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:50.451263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e8158e2a-9d0f-42ed-97c1-9c298baef585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a2386f3557459f919411ecad891438'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:50.503856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 892/1797] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:49 2022] DELETE /identity/v3/users/74a2386f3557459f919411ecad891438 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:50.823540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9377e-4db4-4c67-9273-4e0507625782 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:50.824646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9377e-4db4-4c67-9273-4e0507625782 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:50.825094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9377e-4db4-4c67-9273-4e0507625782 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:50.828491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 906/1798] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:47:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:50.910013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:50.910553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:50.910553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:50.934791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:50.936829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:51.163939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 893/1799] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:47:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:51.457843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9377e-4db4-4c67-9273-4e0507625782 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:51.461310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6bd9377e-4db4-4c67-9273-4e0507625782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:51.535072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:51.538369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:51.581232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0e7b6-50cb-401d-8f5a-575fd90a8c34 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:51.598340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45edf8-d51f-42ca-8ce5-af4ac6f024a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:51.601028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45edf8-d51f-42ca-8ce5-af4ac6f024a0 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:51.602996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45edf8-d51f-42ca-8ce5-af4ac6f024a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:51.603450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45edf8-d51f-42ca-8ce5-af4ac6f024a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:51.647698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45edf8-d51f-42ca-8ce5-af4ac6f024a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:51.649442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45edf8-d51f-42ca-8ce5-af4ac6f024a0 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:51.687345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 894/1800] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:51.846690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9377e-4db4-4c67-9273-4e0507625782 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:51.859617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:51.864084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:51.867209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:51.868553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] PATH_INFO: `/v3/projects/e274e0c7f5ca4b7e9c5f0214f09b84ed` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:51.878080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e274e0c7f5ca4b7e9c5f0214f09b84ed)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:51.885083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:52.031128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e274e0c7f5ca4b7e9c5f0214f09b84ed', 'request_id': 'req-606dc3f7-3f99-4b14-8476-57a159e87c85'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:52.040346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e274e0c7f5ca4b7e9c5f0214f09b84ed', 'request_id': 'req-606dc3f7-3f99-4b14-8476-57a159e87c85'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:52.046126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:52.051782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e274e0c7f5ca4b7e9c5f0214f09b84ed', 'request_id': 'req-606dc3f7-3f99-4b14-8476-57a159e87c85'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:52.093243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] The token cache is being invalidate because project e274e0c7f5ca4b7e9c5f0214f09b84ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:52.093542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:52.097772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-606dc3f7-3f99-4b14-8476-57a159e87c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:52.103623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 907/1801] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:51 2022] DELETE /identity/v3/projects/e274e0c7f5ca4b7e9c5f0214f09b84ed => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:52.109204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606fc9b-0440-4f20-8b0b-053a3184ec07 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:52.110400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606fc9b-0440-4f20-8b0b-053a3184ec07 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:52.110888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606fc9b-0440-4f20-8b0b-053a3184ec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:52.194625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3606fc9b-0440-4f20-8b0b-053a3184ec07 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:52.198461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3606fc9b-0440-4f20-8b0b-053a3184ec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:52.304222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae963d-f73d-48a1-9651-6e89663c0c82 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:52.304565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae963d-f73d-48a1-9651-6e89663c0c82 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:52.305812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae963d-f73d-48a1-9651-6e89663c0c82 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:52.307617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 908/1802] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:47:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:47:52.397636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:52.398763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:52.399055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:52.487939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 895/1803] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:52.498104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:52.498578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:52.498884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:52.513523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:52.522014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:52.621781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:52.625000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:52.660778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 896/1804] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:52.662432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:52.683785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f01b2-2ae1-4251-b695-687a406733ee None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:52.719470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:52.720108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:52.722612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:52.725117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:52.726409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:52.726830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:52.730808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:52.771413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 897/1805] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:52.776508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:52.797250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 909/1806] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:52.803194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1faf-3ee9-48aa-aeb6-81f68d7a4e6b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:52.811129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:52.811953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:52.812650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:52.813320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:52.814957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:52.818492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:52.894219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 898/1807] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:52 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:52.894911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:52.910218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e3657-05a0-4653-b323-8883be7fe78b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:53.070359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:53.071510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.072340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.072941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.073898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:53.079389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:53.146572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:53.159271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 910/1808] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:52 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:47:53.175041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456ee5f-ae55-4a30-83b3-d7676e524faa admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:53.183216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:53.184509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.185065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.186369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.188762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:53.192346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:53.275597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:53.285888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796bac-a4b8-4256-89fe-71e6ac8001f5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:53.292319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 899/1809] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:53.314490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975318d4-9638-4039-9d5b-330b730e4322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:53.315142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975318d4-9638-4039-9d5b-330b730e4322 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.315618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975318d4-9638-4039-9d5b-330b730e4322 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.316044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975318d4-9638-4039-9d5b-330b730e4322 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.317086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975318d4-9638-4039-9d5b-330b730e4322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:53.319027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975318d4-9638-4039-9d5b-330b730e4322 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:53.360047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 911/1810] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:47:53.365251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:53.373784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:53.379776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0129-b4e0-4886-9771-f9f477e91038 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:53.390255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:53.392091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.392651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.393484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] PATH_INFO: `/v3/projects/4436e633cf8b40ce97d05e134ed38330/users/6c10728c0dc44fba893700419d941b34/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.421943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4436e633cf8b40ce97d05e134ed38330, user_id=6c10728c0dc44fba893700419d941b34, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:53.425991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:53.466147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 900/1811] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:53 2022] PUT /identity/v3/projects/4436e633cf8b40ce97d05e134ed38330/users/6c10728c0dc44fba893700419d941b34/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:53.482939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.483588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.483911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.570195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] MFA Rules not processed for user `6c10728c0dc44fba893700419d941b34`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:53.575636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:53.639379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:53.641288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:53.705505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:53.759254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 912/1812] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:53.765050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:53.853026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee717e-86c8-4e54-b52a-c7e82e99d009 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:53.866757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:53.868274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.870204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.870596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] PATH_INFO: `/v3/users/bb905fb648a848c49332b43c8c1862e0` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.873677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb905fb648a848c49332b43c8c1862e0)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:53.879476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:53.894377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1aa9a-4738-46a9-8d34-c77003dc65a6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:53.904476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:53.905282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:53.905669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:53.906050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:53.907382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:53.911030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:53.962409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 913/1813] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:53 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:53.963436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:53.966138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.010637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb905fb648a848c49332b43c8c1862e0'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.011763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb905fb648a848c49332b43c8c1862e0'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.032747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb905fb648a848c49332b43c8c1862e0'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.047446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb905fb648a848c49332b43c8c1862e0'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.049231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb905fb648a848c49332b43c8c1862e0'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.106704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37e4b-96d6-400e-b486-9c1239af5778 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:54.121710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 901/1814] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:53 2022] DELETE /identity/v3/users/bb905fb648a848c49332b43c8c1862e0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:54.123283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:54.125516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.132969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:54.134308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.134584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.134859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] PATH_INFO: `/v3/projects/b84140bdde034d06901064b73c8bfa21` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.136977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84140bdde034d06901064b73c8bfa21)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:54.141465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:54.279225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84140bdde034d06901064b73c8bfa21', 'request_id': 'req-b7208426-79c6-4616-9822-5050677926b6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.304707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84140bdde034d06901064b73c8bfa21', 'request_id': 'req-b7208426-79c6-4616-9822-5050677926b6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.329234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84140bdde034d06901064b73c8bfa21', 'request_id': 'req-b7208426-79c6-4616-9822-5050677926b6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.349888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074916f1-c951-40c8-899f-7ef1c87bf783 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:54.367402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:54.377047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] The token cache is being invalidate because project b84140bdde034d06901064b73c8bfa21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:54.377352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.379975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b7208426-79c6-4616-9822-5050677926b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:54.381961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 914/1815] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:53 2022] DELETE /identity/v3/projects/b84140bdde034d06901064b73c8bfa21 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:54.397473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff103-4515-49e4-9190-1a224d8348fe None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.397907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff103-4515-49e4-9190-1a224d8348fe None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.398106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff103-4515-49e4-9190-1a224d8348fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.423967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:54.453571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cd1ff103-4515-49e4-9190-1a224d8348fe None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:54.460772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cd1ff103-4515-49e4-9190-1a224d8348fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.511265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:54.512365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.512365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.512583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.513286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:54.519687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:54.580687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 902/1816] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:54 2022] POST /identity/v3/users => generated 297 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:54.582607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:54.590025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.635387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 915/1817] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:54.635387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.635387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.635387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.694467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:54.698256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.718201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 916/1818] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:54.719239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:54.722541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.738763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43bdcc-7354-4cc8-93d1-a367f0fe11c2 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:54.747155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903acb8-777e-4811-aacb-0f3dbfaeaf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:54.748832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903acb8-777e-4811-aacb-0f3dbfaeaf5e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.749282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903acb8-777e-4811-aacb-0f3dbfaeaf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.749571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903acb8-777e-4811-aacb-0f3dbfaeaf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.750253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903acb8-777e-4811-aacb-0f3dbfaeaf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:54.752529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903acb8-777e-4811-aacb-0f3dbfaeaf5e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:54.792187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 917/1819] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:54.792187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.792187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.792187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.807132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090869d-3791-4088-be92-c7e8c59b6dec admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:54.823637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:54.824335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.824665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.824971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.829407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.843286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:54.847063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:54.865944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:54.871813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:54.872211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 918/1820] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:54.877440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:54.904953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd50f0-3294-4958-bdbb-f48d01597915 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:54.914095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 903/1821] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:54.916391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:54.938614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0bef-962c-49ad-9839-042c7ef9d966 service nova] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:54.942594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:54.943622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.943913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.944197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] PATH_INFO: `/v3/projects/f967cbe54b854951bf0b4cfa0b467ca3/users/2d4b03f7a53247448fcc10581b0ef3a4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.955782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:54.956608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:54.957722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:54.960234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:54.961825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:54.962300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:54.966363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:54.993152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 904/1822] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:54.994286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.006264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:55.012227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f967cbe54b854951bf0b4cfa0b467ca3, user_id=2d4b03f7a53247448fcc10581b0ef3a4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.027435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.064394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 919/1823] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:54 2022] PUT /identity/v3/projects/f967cbe54b854951bf0b4cfa0b467ca3/users/2d4b03f7a53247448fcc10581b0ef3a4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:55.065448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.156652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788658b2-de9b-4674-8efb-284ce2dec689 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.252439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:55.272157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e56e20-1a25-4dc3-8538-c48b5badf435 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.307309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.308051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.308462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.308740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.309529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.313001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.352536 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.353338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.353610 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.353915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.382544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.385205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 920/1824] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:55 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:55.386562 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.388134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.417145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 905/1825] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:55.418306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.446866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6ab9-cf85-46e5-a547-abb142919750 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.514345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:55.569490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52291b70-3bcb-4bc4-932b-a0ceaa2caafd admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.581946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.583689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.584103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.584384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.586089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.589904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.614763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.614979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 921/1826] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:55.618527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.619020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.619311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.620033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.621159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.629171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.671808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c67a2-4d1e-4ab3-a72c-6e313f9a987c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.678060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 906/1827] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:55 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:55.682241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9be209-53ee-4c4a-96eb-aac0fafeb76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.682535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.683945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9be209-53ee-4c4a-96eb-aac0fafeb76a admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.684410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9be209-53ee-4c4a-96eb-aac0fafeb76a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.684747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9be209-53ee-4c4a-96eb-aac0fafeb76a admin admin] PATH_INFO: `/v3/projects/f967cbe54b854951bf0b4cfa0b467ca3/users/2d4b03f7a53247448fcc10581b0ef3a4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.686936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9be209-53ee-4c4a-96eb-aac0fafeb76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f967cbe54b854951bf0b4cfa0b467ca3, user_id=2d4b03f7a53247448fcc10581b0ef3a4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.690927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9be209-53ee-4c4a-96eb-aac0fafeb76a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.709775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5799955-96f6-4d36-a733-43a378f0974f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.725749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 922/1828] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:55 2022] PUT /identity/v3/projects/f967cbe54b854951bf0b4cfa0b467ca3/users/2d4b03f7a53247448fcc10581b0ef3a4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:55.736273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.736605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.736858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.808047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.808703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.809054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.809401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.810826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.816005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.816134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] MFA Rules not processed for user `2d4b03f7a53247448fcc10581b0ef3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:55.817226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:55.837148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 907/1829] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:55.840649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.856364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f4444-63eb-4fbe-9db9-d0b46f442318 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.862528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.863697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.863986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.864345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.865922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.867955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.889201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 908/1830] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:55.893152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.910305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e149a9-d642-4f98-a8b6-55244ec7f38e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:55.932012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e96e98-940e-447b-b749-951d63898711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:55.932012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96e98-940e-447b-b749-951d63898711 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.932388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96e98-940e-447b-b749-951d63898711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.932388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96e98-940e-447b-b749-951d63898711 admin admin] PATH_INFO: `/v3/projects/535bcd6e4e344852bb7750e390f03675/users/94277b55077643b3a49ee2e3c9d2625c/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:55.933531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 923/1831] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:55.945149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:55.946857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:55.951990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96e98-940e-447b-b749-951d63898711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535bcd6e4e344852bb7750e390f03675, user_id=94277b55077643b3a49ee2e3c9d2625c, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:55.954445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96e98-940e-447b-b749-951d63898711 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:55.973001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 909/1832] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:55 2022] PUT /identity/v3/projects/535bcd6e4e344852bb7750e390f03675/users/94277b55077643b3a49ee2e3c9d2625c/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:55.983395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:55.983704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:55.983981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.045899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097e3e-c735-42ea-ba83-63c2a1e333f2 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.064152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] MFA Rules not processed for user `94277b55077643b3a49ee2e3c9d2625c`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:56.065428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:56.074211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:56.170303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.170303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.170303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.170303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.211123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:56.256952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 910/1833] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:47:56.257916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.330774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.332492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.353098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 924/1834] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:56.365025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225f436-ed37-4d9d-80b4-c5f6a7cd4a29 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.370829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.372602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.374263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.374685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.375783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.379513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.424151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 911/1835] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:56 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:56.429185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.447248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0160ea-3765-49a6-a696-b21b60a39f94 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.522182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.528143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.529101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.529489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.530415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.530767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.533156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.568683 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 925/1836] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:56 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:56.570370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.584491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758339ba-7411-47b5-b71f-ee67699da18a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.592701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.593294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.593682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.594218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.595202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.597393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.606542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4321c1-a2c2-47f1-803d-d5df803cda89 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.612096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.613050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.613640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.614045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.616445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 926/1837] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:56.617417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.627124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:56.645885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b05db-c0da-448b-ba14-9c1ec7341b3c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.661013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.663168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.663614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.663899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] PATH_INFO: `/v3/projects/75df02544ccc42f4bf88f78bcc0fdc07/users/36bfe3d04cb942d68fd7ca2edf575db9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.696651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:56.705561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75df02544ccc42f4bf88f78bcc0fdc07, user_id=36bfe3d04cb942d68fd7ca2edf575db9, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.708645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.717587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.719051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.739266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 927/1838] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:56 2022] PUT /identity/v3/projects/75df02544ccc42f4bf88f78bcc0fdc07/users/36bfe3d04cb942d68fd7ca2edf575db9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:56.740904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.759720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 912/1839] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:56.860425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee73ce0-116f-4dab-8115-30de5face21a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.869998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.871894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.872351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.872978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.873888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.876412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.896172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 928/1840] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:56.896461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.914275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6601-5ccc-4825-9a2d-ac6ede4e5774 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:56.920778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121241d-6223-4fa1-b396-831c58d890ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:56.921464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121241d-6223-4fa1-b396-831c58d890ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.921744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121241d-6223-4fa1-b396-831c58d890ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.922022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121241d-6223-4fa1-b396-831c58d890ac admin admin] PATH_INFO: `/v3/projects/75df02544ccc42f4bf88f78bcc0fdc07/users/36bfe3d04cb942d68fd7ca2edf575db9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.924276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121241d-6223-4fa1-b396-831c58d890ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=75df02544ccc42f4bf88f78bcc0fdc07, user_id=36bfe3d04cb942d68fd7ca2edf575db9, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:56.929702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121241d-6223-4fa1-b396-831c58d890ac admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:56.957591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:56.959312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 913/1841] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:56 2022] PUT /identity/v3/projects/75df02544ccc42f4bf88f78bcc0fdc07/users/36bfe3d04cb942d68fd7ca2edf575db9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:56.960396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:56.965995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:56.970707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:56.970995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:56.975615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:56.984680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9258f-33cb-4566-a7f7-3255aa56774a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:57.039826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] MFA Rules not processed for user `36bfe3d04cb942d68fd7ca2edf575db9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:57.041422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.088075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:57.088751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:57.089042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:57.089335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] PATH_INFO: `/v3/projects/aa6a894171a04e5dac0ca70700b1a68d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:57.090521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6a894171a04e5dac0ca70700b1a68d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:57.092550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:57.191407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6a894171a04e5dac0ca70700b1a68d', 'request_id': 'req-3eabef5a-9fda-4e70-aa31-847605007d00'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.205302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6a894171a04e5dac0ca70700b1a68d', 'request_id': 'req-3eabef5a-9fda-4e70-aa31-847605007d00'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.222375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6a894171a04e5dac0ca70700b1a68d', 'request_id': 'req-3eabef5a-9fda-4e70-aa31-847605007d00'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.225239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 914/1842] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:57.238750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:57.264984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] The token cache is being invalidate because project aa6a894171a04e5dac0ca70700b1a68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:57.265280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.266025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.272782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 929/1843] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:56 2022] DELETE /identity/v3/projects/aa6a894171a04e5dac0ca70700b1a68d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:57.279444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:57.281444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.348054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6187109-a5c0-4617-979c-141ee3122431 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:57.431964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabef5a-9fda-4e70-aa31-847605007d00 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:57.434622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:57.435314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:57.435664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:57.435946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:57.437747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.439182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:57.439939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:57.440613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:57.441100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] PATH_INFO: `/v3/users/bc539f74d3b44fe7937397edf7c66614` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:57.442473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc539f74d3b44fe7937397edf7c66614)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:57.445056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:57.481370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:57.487987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:57.499321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc539f74d3b44fe7937397edf7c66614'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.500263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc539f74d3b44fe7937397edf7c66614'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.508193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc539f74d3b44fe7937397edf7c66614'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.509089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc539f74d3b44fe7937397edf7c66614'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.517530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-06a07e88-322a-489b-ae4a-db872a604784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc539f74d3b44fe7937397edf7c66614'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.521608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:57.523201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:57.534865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 915/1844] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:47:57.538237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 930/1845] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:57 2022] DELETE /identity/v3/users/bc539f74d3b44fe7937397edf7c66614 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:57.612513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:57.614904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.629606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b106ee3-6250-45bf-ae32-8c6ba9672a15 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:57.701798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:57.702460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:57.702855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:57.703139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] PATH_INFO: `/v3/users/94277b55077643b3a49ee2e3c9d2625c` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:57.704574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94277b55077643b3a49ee2e3c9d2625c)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:57.706490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:57.767660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94277b55077643b3a49ee2e3c9d2625c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.768497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94277b55077643b3a49ee2e3c9d2625c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.777737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94277b55077643b3a49ee2e3c9d2625c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.788803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94277b55077643b3a49ee2e3c9d2625c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.789666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94277b55077643b3a49ee2e3c9d2625c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:57.820766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 916/1846] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:57 2022] DELETE /identity/v3/users/94277b55077643b3a49ee2e3c9d2625c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:57.824126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:57.824126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:57.824380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:57.846607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:57.847841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.949316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 931/1847] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:57.956265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:57.959060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.976521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:57.978238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:57.998407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8dd58-79e0-4f08-8ea2-db309a930658 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.006242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.007167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.007673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.008284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] PATH_INFO: `/v3/projects/51321a5bbdc34178b945aea6992e1914` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.010859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51321a5bbdc34178b945aea6992e1914)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.015572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.102012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:58.104801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51321a5bbdc34178b945aea6992e1914', 'request_id': 'req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:58.114153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51321a5bbdc34178b945aea6992e1914', 'request_id': 'req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:58.127190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51321a5bbdc34178b945aea6992e1914', 'request_id': 'req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:58.143138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff97c52-e48e-4aca-b72b-a0f59f906e57 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.150262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] The token cache is being invalidate because project 51321a5bbdc34178b945aea6992e1914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:58.150863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:58.152021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1e6f83f6-d251-4bc0-a9ba-5c090e609db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:58.157834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 932/1848] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:57 2022] DELETE /identity/v3/projects/51321a5bbdc34178b945aea6992e1914 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:58.159626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352508e8-ad9d-4e29-8d5c-af05e3e3d1ad None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.160662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352508e8-ad9d-4e29-8d5c-af05e3e3d1ad None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.161703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352508e8-ad9d-4e29-8d5c-af05e3e3d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.201710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-352508e8-ad9d-4e29-8d5c-af05e3e3d1ad None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:58.202956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-352508e8-ad9d-4e29-8d5c-af05e3e3d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:58.229871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.230924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.231697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.232160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.234263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:58.248095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:58.291533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 933/1849] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:58.299484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.299775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.300049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.329788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.332023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.343105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 917/1850] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:47:58.355648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:58.357083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:58.373033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 934/1851] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:58.373801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:58.389642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a40a7-aeff-41bf-844e-a4cc2f6a1fba service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.394894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.396461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.396874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.397223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.397957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:58.398332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.400166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.420770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 918/1852] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:58.422934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:58.436518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca2bd6-cf5b-4a07-a98a-c44779115a36 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.442646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.444263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.444614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.445004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.446715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.449738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.524079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 935/1853] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:58.525074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:58.548686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1ae0b-9f93-4f75-8044-be6f01a8d6cb admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.623695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.624988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.625401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.626055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.627136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.629034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.673921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 919/1854] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:58.679021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:58.698653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0569-657c-4edd-8ec4-7e1ae90269bc admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.719191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.720998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.721358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.722499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.724811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.726783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.749133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 936/1855] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:58.751468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:58.766566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1222-4450-4519-8398-b01fa27fe10b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.775357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bbefc-4d44-4e1a-b85e-38e5aff23579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.775908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bbefc-4d44-4e1a-b85e-38e5aff23579 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.776271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bbefc-4d44-4e1a-b85e-38e5aff23579 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.776613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bbefc-4d44-4e1a-b85e-38e5aff23579 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.777744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bbefc-4d44-4e1a-b85e-38e5aff23579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.780677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bbefc-4d44-4e1a-b85e-38e5aff23579 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.800624 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 920/1856] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:47:58.807823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:58.824338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7538980-783a-40b6-a17e-d8b17973b989 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:58.830929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:58.830929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.831245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.831245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] PATH_INFO: `/v3/projects/9d4dba9197c241719e961f9f25905bf3/users/2b63624964414e1d88b899c2d679cea4/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.854164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4dba9197c241719e961f9f25905bf3, user_id=2b63624964414e1d88b899c2d679cea4, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:58.857373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:58.877281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 937/1857] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:58 2022] PUT /identity/v3/projects/9d4dba9197c241719e961f9f25905bf3/users/2b63624964414e1d88b899c2d679cea4/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:58.891265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.891659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.892034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.940771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] MFA Rules not processed for user `2b63624964414e1d88b899c2d679cea4`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:58.942933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:58.947497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.024851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 921/1858] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:59.029390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.126117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de741174-bd0d-4110-8059-db68af0e10e9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.132767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.133550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.133904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.134250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.135043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.137671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.176624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 938/1859] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:59 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:59.180785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.189291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.192006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.199367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e468e-3fbb-4580-9055-4cc1c2a2e395 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.289177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6548fc-d273-4111-bd9c-00f35ee830f6 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.291872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.292662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.293115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.293332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.293981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.294587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.295278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.295619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.295909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.296022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] PATH_INFO: `/v3/projects/535bcd6e4e344852bb7750e390f03675` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.297157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=535bcd6e4e344852bb7750e390f03675)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.299134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.300991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.323473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 922/1860] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:59 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:59.329699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.342423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483ec3-de3f-4e02-87da-fa86f0aa35d7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.357184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535bcd6e4e344852bb7750e390f03675', 'request_id': 'req-39354f53-ab72-41c6-8043-d0a699618faa'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.364678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535bcd6e4e344852bb7750e390f03675', 'request_id': 'req-39354f53-ab72-41c6-8043-d0a699618faa'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.375048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535bcd6e4e344852bb7750e390f03675', 'request_id': 'req-39354f53-ab72-41c6-8043-d0a699618faa'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.388745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] The token cache is being invalidate because project 535bcd6e4e344852bb7750e390f03675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:47:59.389055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.390568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.392312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 939/1861] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:47:59 2022] DELETE /identity/v3/projects/535bcd6e4e344852bb7750e390f03675 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:47:59.397092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.398936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.420633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.421317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.421595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.421867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.422517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.424683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.442721 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 923/1862] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:59.443634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.445410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.460565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3072b1-2d79-48a6-9c40-f1c934ebc178 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.465416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.466113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.466390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.466738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] PATH_INFO: `/v3/projects/68f33ff7173b4a5f895532384f13aa37/users/fdf3f450c4d14015a241e8e00c7584da/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.485993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39354f53-ab72-41c6-8043-d0a699618faa admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.487487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f33ff7173b4a5f895532384f13aa37, user_id=fdf3f450c4d14015a241e8e00c7584da, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.491488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.491674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.492146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.492485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.493567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] PATH_INFO: `/v3/users/36bfe3d04cb942d68fd7ca2edf575db9` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.497143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36bfe3d04cb942d68fd7ca2edf575db9)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.499468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.512670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 924/1863] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:59 2022] PUT /identity/v3/projects/68f33ff7173b4a5f895532384f13aa37/users/fdf3f450c4d14015a241e8e00c7584da/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:59.516846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.537835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.572761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36bfe3d04cb942d68fd7ca2edf575db9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.573880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36bfe3d04cb942d68fd7ca2edf575db9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.582195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36bfe3d04cb942d68fd7ca2edf575db9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.583813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36bfe3d04cb942d68fd7ca2edf575db9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.595164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36bfe3d04cb942d68fd7ca2edf575db9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.623030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 940/1864] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:59 2022] DELETE /identity/v3/users/36bfe3d04cb942d68fd7ca2edf575db9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:59.659867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89bb1c-a061-4ca2-847a-8066ad37ce67 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.730220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.731209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.731638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.732891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.734118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.737687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.751830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 925/1865] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:47:59.757845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.759441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.782261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.783170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7847a-c321-462d-9e5c-5ab88164a852 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.784153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.798063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0247c-e13e-48cc-a6f4-186dedcb84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.798425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1157-646f-407d-b3aa-9d3fd24dddbe admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.798758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0247c-e13e-48cc-a6f4-186dedcb84ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.799041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0247c-e13e-48cc-a6f4-186dedcb84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.799359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0247c-e13e-48cc-a6f4-186dedcb84ec admin admin] PATH_INFO: `/v3/projects/68f33ff7173b4a5f895532384f13aa37/users/fdf3f450c4d14015a241e8e00c7584da/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.804034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.804915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.805294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.805657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] PATH_INFO: `/v3/users/6c10728c0dc44fba893700419d941b34` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.806989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c10728c0dc44fba893700419d941b34)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.808423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0247c-e13e-48cc-a6f4-186dedcb84ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f33ff7173b4a5f895532384f13aa37, user_id=fdf3f450c4d14015a241e8e00c7584da, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.809224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.812101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0247c-e13e-48cc-a6f4-186dedcb84ec admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.815915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.855632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 941/1866] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:47:59 2022] PUT /identity/v3/projects/68f33ff7173b4a5f895532384f13aa37/users/fdf3f450c4d14015a241e8e00c7584da/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:59.858418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.858688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.858997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.911631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] MFA Rules not processed for user `fdf3f450c4d14015a241e8e00c7584da`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:59.913048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.923653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c10728c0dc44fba893700419d941b34'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.939815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c10728c0dc44fba893700419d941b34'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.971893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c10728c0dc44fba893700419d941b34'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.992658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c10728c0dc44fba893700419d941b34'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:47:59.993746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-60b86599-b97e-4bf9-a8a3-47c04e76b17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c10728c0dc44fba893700419d941b34'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:00.044251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 926/1867] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:47:59 2022] DELETE /identity/v3/users/6c10728c0dc44fba893700419d941b34 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:00.045810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.046095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.046370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.053590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 942/1868] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:47:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:00.065686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.067681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.073961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:00.075602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.111647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:00.231436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 927/1869] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:00.236975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5552-f84b-4fcd-a975-cbd196fcf182 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:00.262831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.264357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.373932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:00.374640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.374989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.375336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.404578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84060f8-7ffe-4b15-b93a-e3cebb219e3b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:00.416195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:00.418595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.420656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.421156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.444010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:00.447951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:00.454793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:00.496947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:00.502252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:00.515700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 928/1870] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:00.554076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 943/1871] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:00.620445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.622833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.639483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674bbdc-e042-4f62-98fa-3ce9e4f0eca8 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:00.644931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:00.646229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.646948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.646948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.651435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.742637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:00.744083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbc43d-9d01-4e6a-a4e2-cf6a0afe8e75 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:00.761371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 929/1872] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:00.907550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.909106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.930819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e15f02-ebae-4de4-9d88-5eab10181ca9 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:00.937226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:00.939070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.939828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.940235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] PATH_INFO: `/v3/projects/75df02544ccc42f4bf88f78bcc0fdc07` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.942219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75df02544ccc42f4bf88f78bcc0fdc07)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:00.944655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.082535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75df02544ccc42f4bf88f78bcc0fdc07', 'request_id': 'req-aefcfc01-4c97-422b-a0e4-d4b308af2c28'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.090860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75df02544ccc42f4bf88f78bcc0fdc07', 'request_id': 'req-aefcfc01-4c97-422b-a0e4-d4b308af2c28'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.109080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75df02544ccc42f4bf88f78bcc0fdc07', 'request_id': 'req-aefcfc01-4c97-422b-a0e4-d4b308af2c28'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.130349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] The token cache is being invalidate because project 75df02544ccc42f4bf88f78bcc0fdc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:01.130833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.131927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.133940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 944/1873] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:00 2022] DELETE /identity/v3/projects/75df02544ccc42f4bf88f78bcc0fdc07 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:01.138682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f8363-a7c4-4cbe-ae0f-04500ab9f047 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.139407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f8363-a7c4-4cbe-ae0f-04500ab9f047 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.139407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f8363-a7c4-4cbe-ae0f-04500ab9f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.162402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8f3f8363-a7c4-4cbe-ae0f-04500ab9f047 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:01.163725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8f3f8363-a7c4-4cbe-ae0f-04500ab9f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.203416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.205179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.260764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 930/1874] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:01.268509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.268830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.269112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.280018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:01.295898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:01.297145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.299467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcfc01-4c97-422b-a0e4-d4b308af2c28 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.311786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 931/1875] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:01.311975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.311975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.311975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.311975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] PATH_INFO: `/v3/projects/4436e633cf8b40ce97d05e134ed38330` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.312294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4436e633cf8b40ce97d05e134ed38330)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.312870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.314935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.323214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20616b4e-70c9-448e-bfa8-79b79e89f2c3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.330015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.330776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.331214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.331498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.333461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:01.335174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.337622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.352877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 932/1876] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:01.356647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.367927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2404d-e36c-477d-90a4-c75dd285f6a9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.377964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.379904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.380987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.381612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.383010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.385894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.391974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4436e633cf8b40ce97d05e134ed38330', 'request_id': 'req-f788d60d-0a26-4016-bb1c-e8279dd7641c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.401360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4436e633cf8b40ce97d05e134ed38330', 'request_id': 'req-f788d60d-0a26-4016-bb1c-e8279dd7641c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.413294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4436e633cf8b40ce97d05e134ed38330', 'request_id': 'req-f788d60d-0a26-4016-bb1c-e8279dd7641c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.424006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:01.429125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] The token cache is being invalidate because project 4436e633cf8b40ce97d05e134ed38330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:01.429940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.431262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.433453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 945/1877] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:01 2022] DELETE /identity/v3/projects/4436e633cf8b40ce97d05e134ed38330 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:01.437962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.440704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.448512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 933/1878] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:01 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:01.449462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.452122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.559612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788d60d-0a26-4016-bb1c-e8279dd7641c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.608456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1adc4-4c49-49d9-9dd2-aded26847a61 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.620054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.622799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.623355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.623355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.624275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.628062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.679196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 934/1879] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:01 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:01.684367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.688149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.689984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.690261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.690582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] PATH_INFO: `/v3/users/2d4b03f7a53247448fcc10581b0ef3a4` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.693895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4b03f7a53247448fcc10581b0ef3a4)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.696160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.698828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8a92-3300-4f1b-9134-be0b4a37535d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.709134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.709815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.710099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.710462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.711268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.713636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.734597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 935/1880] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:01.735962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.750469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad149894-983c-45b7-b5b4-a22ba21824ab admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.757436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.758094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.758376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.758652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.759306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.761845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.787208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 936/1881] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:01.805190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.827487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a3eef-b430-4026-9791-17fe9b06c5cb admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.827683 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4b03f7a53247448fcc10581b0ef3a4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.828893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4b03f7a53247448fcc10581b0ef3a4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.846648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.847612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4b03f7a53247448fcc10581b0ef3a4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.848892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.849613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4b03f7a53247448fcc10581b0ef3a4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.849817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.850313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] PATH_INFO: `/v3/projects/c4020d9aef4a4f2db4fd2a662e7d6658/users/15fc24da179b47dd845233bd126bb5b5/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.870103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-77a033b3-5a9e-48ff-a9ca-b7127b2b98b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4b03f7a53247448fcc10581b0ef3a4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.891142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4020d9aef4a4f2db4fd2a662e7d6658, user_id=15fc24da179b47dd845233bd126bb5b5, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.896385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.920392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 946/1882] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:01 2022] DELETE /identity/v3/users/2d4b03f7a53247448fcc10581b0ef3a4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:01.922101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 937/1883] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:01 2022] PUT /identity/v3/projects/c4020d9aef4a4f2db4fd2a662e7d6658/users/15fc24da179b47dd845233bd126bb5b5/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:01.942782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.943064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.943746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.990081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] MFA Rules not processed for user `15fc24da179b47dd845233bd126bb5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:01.992043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.014876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:02.109272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 947/1884] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:02.113975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.117056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.223174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54599-5ede-420b-a9b4-6c448233358c admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:02.243257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:02.319023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:02.320411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.320698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.321004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.321660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:02.324016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:02.357048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.358612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.375140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 938/1885] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:02 2022] POST /identity/v3/projects => generated 381 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:02.379464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.382704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fb205-e788-4164-9e2f-2a7db995d451 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:02.515980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b0906-6664-4b10-8540-9bbea70ca6ed admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:02.519807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:02.520730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.521085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.521353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] PATH_INFO: `/v3/projects/f967cbe54b854951bf0b4cfa0b467ca3` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.522692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f967cbe54b854951bf0b4cfa0b467ca3)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:02.524934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:02.530149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f8c3-ee20-4840-94bf-35e5bcbfca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:02.531588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f8c3-ee20-4840-94bf-35e5bcbfca33 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.531869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f8c3-ee20-4840-94bf-35e5bcbfca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.532143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f8c3-ee20-4840-94bf-35e5bcbfca33 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.532808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f8c3-ee20-4840-94bf-35e5bcbfca33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:02.535476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f8c3-ee20-4840-94bf-35e5bcbfca33 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:02.588315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 939/1886] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:02 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:02.590301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f967cbe54b854951bf0b4cfa0b467ca3', 'request_id': 'req-c6668461-158b-4295-af12-b40ba6035c74'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.590722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995181-9cef-4dc4-956d-ca2cbddb780b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.591009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995181-9cef-4dc4-956d-ca2cbddb780b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.591283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995181-9cef-4dc4-956d-ca2cbddb780b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.596398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 940/1887] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:48:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:48:02.597050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995181-9cef-4dc4-956d-ca2cbddb780b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.597760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f967cbe54b854951bf0b4cfa0b467ca3', 'request_id': 'req-c6668461-158b-4295-af12-b40ba6035c74'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.610607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f967cbe54b854951bf0b4cfa0b467ca3', 'request_id': 'req-c6668461-158b-4295-af12-b40ba6035c74'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.651246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] The token cache is being invalidate because project f967cbe54b854951bf0b4cfa0b467ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:02.651538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.657018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-c6668461-158b-4295-af12-b40ba6035c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.662386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 948/1888] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:02 2022] DELETE /identity/v3/projects/f967cbe54b854951bf0b4cfa0b467ca3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:02.665781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61da03-56d0-4426-864a-66a992453d57 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.666065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61da03-56d0-4426-864a-66a992453d57 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.669117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61da03-56d0-4426-864a-66a992453d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.704616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9f61da03-56d0-4426-864a-66a992453d57 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:02.706641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9f61da03-56d0-4426-864a-66a992453d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.733422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995181-9cef-4dc4-956d-ca2cbddb780b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:02.739246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972913e-ce4a-4058-ac58-f7212e01a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:02.740255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972913e-ce4a-4058-ac58-f7212e01a0cc admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.740535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972913e-ce4a-4058-ac58-f7212e01a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.740866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972913e-ce4a-4058-ac58-f7212e01a0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.741530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972913e-ce4a-4058-ac58-f7212e01a0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:02.743962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972913e-ce4a-4058-ac58-f7212e01a0cc admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:02.760479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 941/1889] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:02.761754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.762044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.762320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.765070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:02.785160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:02.786916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.808239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 942/1890] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:02.808239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.808239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.828540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2f72-c8a4-4d86-9bcc-13b1944a776b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:02.830408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 949/1891] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:02.831473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e91b9-8087-4fac-820c-965763726c52 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.831751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e91b9-8087-4fac-820c-965763726c52 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.832189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e91b9-8087-4fac-820c-965763726c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.843133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:02.843826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.844115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.844374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] PATH_INFO: `/v3/projects/140dd2ed145845cf8f51051392ae4b73/users/2a213dcc76554d178cba83ca2f4be902/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.868385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-629e91b9-8087-4fac-820c-965763726c52 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:02.871089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-629e91b9-8087-4fac-820c-965763726c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.881662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140dd2ed145845cf8f51051392ae4b73, user_id=2a213dcc76554d178cba83ca2f4be902, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:02.894383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:02.894383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:02.895589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 950/1892] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:02.897639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e91b9-8087-4fac-820c-965763726c52 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.899577 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-629e91b9-8087-4fac-820c-965763726c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.915200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 943/1893] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:02 2022] PUT /identity/v3/projects/140dd2ed145845cf8f51051392ae4b73/users/2a213dcc76554d178cba83ca2f4be902/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:02.919044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.931349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e91b9-8087-4fac-820c-965763726c52 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.032821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.033681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.034216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.034645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.036387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764a1cd-11ab-4ed8-a02d-9018fa19c475 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.041821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.042598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.042779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.043059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.043935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:03.044240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.046225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.052146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.054923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.065785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 944/1894] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:03.066776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.071959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 951/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:03.077844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.081626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daa17a-ad6e-4b26-ad4a-0f70b7f72f99 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.100994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.101137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcfc2f-caf2-4d40-a41e-ac06bf0c1a38 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.109785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.109785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.109785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.109785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.109785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.132572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.133853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.134510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.135011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.137737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 945/1896] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:03.138059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.140433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.149199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.176089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639202-387b-43fc-9b3c-08e55c5ea96d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.190150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 952/1897] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:03 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:03.192322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.198917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e8e9-54f1-4209-86de-e74808063e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.199719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e8e9-54f1-4209-86de-e74808063e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.200138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e8e9-54f1-4209-86de-e74808063e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.201547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e8e9-54f1-4209-86de-e74808063e9c admin admin] PATH_INFO: `/v3/projects/140dd2ed145845cf8f51051392ae4b73/users/2a213dcc76554d178cba83ca2f4be902/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.210210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e8e9-54f1-4209-86de-e74808063e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=140dd2ed145845cf8f51051392ae4b73, user_id=2a213dcc76554d178cba83ca2f4be902, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.214396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e8e9-54f1-4209-86de-e74808063e9c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.263240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 946/1898] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:03 2022] PUT /identity/v3/projects/140dd2ed145845cf8f51051392ae4b73/users/2a213dcc76554d178cba83ca2f4be902/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:03.263240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.263240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.263240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.332426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] MFA Rules not processed for user `2a213dcc76554d178cba83ca2f4be902`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:03.333992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:03.347488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aabd68-b0e8-4d8d-9a87-b7b7df0f45b8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.452181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:03.456139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 947/1899] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:03.501389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.502064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.502398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.502722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.503416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.506232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.543639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 953/1900] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:03 2022] POST /identity/v3/users => generated 289 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:03.545698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.560625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d156d3-d0c2-4af1-a082-16851b4d4fc6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.568301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.569274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.569740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.570165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.570983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.573360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.593983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.606217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 948/1901] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:03.611129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf668d2-1bdf-41e8-a3fa-70f2d5dccf83 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.619936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.620817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.621247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.621709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.622564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.624602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.635111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.642686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:03.643750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 954/1902] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:03.651132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.665177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62e360-d380-4c21-a60c-d998acf1f975 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.672361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a48b1-e4ad-4598-8c52-b38f68378fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.673708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a48b1-e4ad-4598-8c52-b38f68378fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.674291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a48b1-e4ad-4598-8c52-b38f68378fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.674818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a48b1-e4ad-4598-8c52-b38f68378fbc admin admin] PATH_INFO: `/v3/projects/2561132ca22e4641a1e03efdc4922120/users/dbac30a86a6446fc872e0170637cabf5/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.700929 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a48b1-e4ad-4598-8c52-b38f68378fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2561132ca22e4641a1e03efdc4922120, user_id=dbac30a86a6446fc872e0170637cabf5, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:03.703982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a48b1-e4ad-4598-8c52-b38f68378fbc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:03.736356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 955/1903] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:03 2022] PUT /identity/v3/projects/2561132ca22e4641a1e03efdc4922120/users/dbac30a86a6446fc872e0170637cabf5/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:03.751024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.751642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.752056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.759425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:03.807993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa9291-8a4c-40b8-bcc2-edd3f203c523 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:03.810067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] MFA Rules not processed for user `dbac30a86a6446fc872e0170637cabf5`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:03.812234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:03.927830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:03.928571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:03.929587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:03.929587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:03.951831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 956/1904] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:03.967618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:03.969628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:04.063533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:04.065019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:04.076649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 949/1905] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:04.101873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f9b5d-0d8e-483e-a10b-2d27186e5afc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:04.110024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:04.111462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:04.112112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:04.112967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:04.134363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:04.136429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:04.154107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 957/1906] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:04.496954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:04.507858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974996-4815-46e7-829e-9ee604bc3527 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:04.514103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a213dcc76554d178cba83ca2f4be902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '140dd2ed145845cf8f51051392ae4b73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:04.514980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:04.515443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:04.515924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:04.516792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:04.517276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:04.519086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:04.538776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 950/1907] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:04.542797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:04.556890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d556-6609-4fd6-a8e1-1964ab3d3b3a service glance] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:04.563741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a213dcc76554d178cba83ca2f4be902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '140dd2ed145845cf8f51051392ae4b73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:04.564610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:04.564877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:04.565158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:04.565810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:04.569037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:04.575861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:04.621303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 958/1908] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:04 2022] POST /identity/v3/projects => generated 354 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:04.626065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:04.642419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4378-3eeb-4803-afe6-6d545ea2d84a tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:04.745037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a213dcc76554d178cba83ca2f4be902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '140dd2ed145845cf8f51051392ae4b73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:04.745657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:04.745944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:04.746222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:04.746927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:04.747234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:04.749524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:04.768170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 951/1909] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:04.854363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:04.868210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd2c44-8c6a-40f9-b6b7-ae189e74edec tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:04.874256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a213dcc76554d178cba83ca2f4be902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '140dd2ed145845cf8f51051392ae4b73', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:04.886461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:04.888140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:04.888528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] PATH_INFO: `/v3/projects/e9af4c0cbe434e91a084c2db8d05cdb8` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:04.890283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9af4c0cbe434e91a084c2db8d05cdb8)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:04.894150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:04.985083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9af4c0cbe434e91a084c2db8d05cdb8', 'request_id': 'req-88e71ea6-4baa-4f78-a481-37d6e8af7582'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:04.993384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9af4c0cbe434e91a084c2db8d05cdb8', 'request_id': 'req-88e71ea6-4baa-4f78-a481-37d6e8af7582'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.003257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9af4c0cbe434e91a084c2db8d05cdb8', 'request_id': 'req-88e71ea6-4baa-4f78-a481-37d6e8af7582'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.027576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] The token cache is being invalidate because project e9af4c0cbe434e91a084c2db8d05cdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:05.027875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.028555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.030498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 959/1910] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:04 2022] DELETE /identity/v3/projects/e9af4c0cbe434e91a084c2db8d05cdb8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:05.178901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:05.180671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:05.220575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:05.270779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083ff2-ca9c-4c01-ae80-173080800ea8 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:05.391432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:05.392488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:05.394233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:05.394458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] PATH_INFO: `/v3/users/2b63624964414e1d88b899c2d679cea4` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:05.399208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b63624964414e1d88b899c2d679cea4)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:05.403073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:05.484782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:05.487119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:05.503903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e71ea6-4baa-4f78-a481-37d6e8af7582 tempest-VolumeQuotaClassesTest-1177974516 tempest-VolumeQuotaClassesTest-1177974516-project-admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:05.510900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:05.511922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:05.512533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:05.512834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] PATH_INFO: `/v3/users/15fc24da179b47dd845233bd126bb5b5` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:05.514352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fc24da179b47dd845233bd126bb5b5)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:05.516435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:05.521045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b63624964414e1d88b899c2d679cea4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.521571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b63624964414e1d88b899c2d679cea4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.533603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b63624964414e1d88b899c2d679cea4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.546870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b63624964414e1d88b899c2d679cea4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.547689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dd326ec6-4db7-4532-9d58-f54338c52267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b63624964414e1d88b899c2d679cea4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.575859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 952/1911] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:05 2022] DELETE /identity/v3/users/2b63624964414e1d88b899c2d679cea4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:05.579751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:05.580044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:05.580324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:05.604819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:05.606122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:05.609152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fc24da179b47dd845233bd126bb5b5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.609923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fc24da179b47dd845233bd126bb5b5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.622431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fc24da179b47dd845233bd126bb5b5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.623181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fc24da179b47dd845233bd126bb5b5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.635856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a7b751ac-9966-4c14-969c-4678af211254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fc24da179b47dd845233bd126bb5b5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:05.666723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:05.690509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 960/1912] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:05 2022] DELETE /identity/v3/users/15fc24da179b47dd845233bd126bb5b5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:05.695528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:05.695809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:05.696145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:05.706656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 953/1913] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:05.730619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:05.734224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:05.742677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:05.743935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:05.808839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:05.867456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 961/1914] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:05.871281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2a20c-984f-4fc1-ab58-eebbd0b0bbb4 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:05.892510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:05.959596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:05.960300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:05.960780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:05.960937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:05.971696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:05.974072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:05.985516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 954/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:05.999140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea838a74-586d-42cd-b210-f4a12a5f9fab None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:06.003184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:06.003894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:06.004177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:06.005135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:06.026067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:06.028829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:06.046725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 962/1916] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:06.516567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:06.518593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:06.548017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234286c8-9c4f-409e-a2d4-b38dc4df3319 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:06.555277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:06.556097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:06.556470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:06.556891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] PATH_INFO: `/v3/projects/9d4dba9197c241719e961f9f25905bf3` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:06.559060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4dba9197c241719e961f9f25905bf3)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:06.562037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:06.649040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4dba9197c241719e961f9f25905bf3', 'request_id': 'req-7435adab-4238-4b3f-8827-d50471467bc5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.654340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4dba9197c241719e961f9f25905bf3', 'request_id': 'req-7435adab-4238-4b3f-8827-d50471467bc5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.663253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4dba9197c241719e961f9f25905bf3', 'request_id': 'req-7435adab-4238-4b3f-8827-d50471467bc5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.664164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:06.665704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:06.683974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] The token cache is being invalidate because project 9d4dba9197c241719e961f9f25905bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:06.683974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.685197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.688921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161cecd-de8d-4578-a459-47138fd2ce48 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:06.690837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 955/1917] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:06 2022] DELETE /identity/v3/projects/9d4dba9197c241719e961f9f25905bf3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:06.694679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:06.696120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:06.744929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:06.773403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:06.775722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:06.776012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:06.776281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] PATH_INFO: `/v3/projects/c4020d9aef4a4f2db4fd2a662e7d6658` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:06.777506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4020d9aef4a4f2db4fd2a662e7d6658)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:06.779662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:06.784359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435adab-4238-4b3f-8827-d50471467bc5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:06.790984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:06.791848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:06.792130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:06.792661 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] PATH_INFO: `/v3/users/fdf3f450c4d14015a241e8e00c7584da` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:06.794023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf3f450c4d14015a241e8e00c7584da)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:06.796701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:06.871448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4020d9aef4a4f2db4fd2a662e7d6658', 'request_id': 'req-edbf892d-71ff-408f-92e8-f6f93f945422'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.881737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4020d9aef4a4f2db4fd2a662e7d6658', 'request_id': 'req-edbf892d-71ff-408f-92e8-f6f93f945422'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.885266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf3f450c4d14015a241e8e00c7584da'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.887869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf3f450c4d14015a241e8e00c7584da'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.897321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4020d9aef4a4f2db4fd2a662e7d6658', 'request_id': 'req-edbf892d-71ff-408f-92e8-f6f93f945422'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.903724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf3f450c4d14015a241e8e00c7584da'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.915153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] The token cache is being invalidate because project c4020d9aef4a4f2db4fd2a662e7d6658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:06.915535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.916677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.918361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf3f450c4d14015a241e8e00c7584da'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.920500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf3f450c4d14015a241e8e00c7584da'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:06.929696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 963/1918] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:06 2022] DELETE /identity/v3/projects/c4020d9aef4a4f2db4fd2a662e7d6658 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:06.930958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:06.939715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:06.966842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 956/1919] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:06 2022] DELETE /identity/v3/users/fdf3f450c4d14015a241e8e00c7584da => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:06.967591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:07.028222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf892d-71ff-408f-92e8-f6f93f945422 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:07.096029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:07.096694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:07.096999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:07.097269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] PATH_INFO: `/v3/users/2a213dcc76554d178cba83ca2f4be902` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:07.099147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a213dcc76554d178cba83ca2f4be902)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:07.101143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:07.169510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a213dcc76554d178cba83ca2f4be902'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.170300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a213dcc76554d178cba83ca2f4be902'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.177697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a213dcc76554d178cba83ca2f4be902'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.178564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a213dcc76554d178cba83ca2f4be902'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.187046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a213dcc76554d178cba83ca2f4be902'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.207156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 964/1920] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:06 2022] DELETE /identity/v3/users/2a213dcc76554d178cba83ca2f4be902 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:07.431465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:07.432982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:07.447241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb909a5-4a05-4941-9a05-2b344790a9a3 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:07.571016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:07.571770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:07.572308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:07.572824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] PATH_INFO: `/v3/projects/68f33ff7173b4a5f895532384f13aa37` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:07.575382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f33ff7173b4a5f895532384f13aa37)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:07.578719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:07.675326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f33ff7173b4a5f895532384f13aa37', 'request_id': 'req-7a7cad09-ef4d-438f-a818-224ad3888d8f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.683523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:07.689990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f33ff7173b4a5f895532384f13aa37', 'request_id': 'req-7a7cad09-ef4d-438f-a818-224ad3888d8f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.715193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f33ff7173b4a5f895532384f13aa37', 'request_id': 'req-7a7cad09-ef4d-438f-a818-224ad3888d8f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.728329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:07.729839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:07.733360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] The token cache is being invalidate because project 68f33ff7173b4a5f895532384f13aa37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:07.733829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.734928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7a7cad09-ef4d-438f-a818-224ad3888d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.736966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 957/1921] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:07 2022] DELETE /identity/v3/projects/68f33ff7173b4a5f895532384f13aa37 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:07.744609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9c984-1887-4233-a323-b99f8413e21a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:07.744609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9c984-1887-4233-a323-b99f8413e21a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:07.744609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9c984-1887-4233-a323-b99f8413e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:07.752137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6caf3-2526-4f66-915b-b89cac55260b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:07.768380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-41f9c984-1887-4233-a323-b99f8413e21a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:07.770487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-41f9c984-1887-4233-a323-b99f8413e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:07.822235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:07.854312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:07.855238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:07.855538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:07.855904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] PATH_INFO: `/v3/projects/140dd2ed145845cf8f51051392ae4b73` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:07.857746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] RBAC: Authorizing `identity:delete_project(project_id=140dd2ed145845cf8f51051392ae4b73)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:07.859729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:07.861569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 958/1922] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:07.866461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:07.866829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:07.867183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:07.895026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:07.896494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:07.918338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 959/1923] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:07.923543 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:07.938631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a53b0-c33f-45dc-b4a9-a08cb80fa5ab None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:07.954726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140dd2ed145845cf8f51051392ae4b73', 'request_id': 'req-5eab8a82-44f8-4d1c-aa79-baae6a83004e'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.974137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140dd2ed145845cf8f51051392ae4b73', 'request_id': 'req-5eab8a82-44f8-4d1c-aa79-baae6a83004e'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:07.998042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140dd2ed145845cf8f51051392ae4b73', 'request_id': 'req-5eab8a82-44f8-4d1c-aa79-baae6a83004e'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:08.017803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] The token cache is being invalidate because project 140dd2ed145845cf8f51051392ae4b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:08.018322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:08.018917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5eab8a82-44f8-4d1c-aa79-baae6a83004e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:08.025379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 965/1924] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:07 2022] DELETE /identity/v3/projects/140dd2ed145845cf8f51051392ae4b73 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:08.030240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65ce2-f2af-4081-920d-315eb00d42cb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.034259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65ce2-f2af-4081-920d-315eb00d42cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.034485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65ce2-f2af-4081-920d-315eb00d42cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.115793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e9a65ce2-f2af-4081-920d-315eb00d42cb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:08.117438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e9a65ce2-f2af-4081-920d-315eb00d42cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:08.125930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.126432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.126711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.126985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.127932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:08.128321 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.130914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.134591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 966/1925] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:08.142506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.143019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.144141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.187333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 960/1926] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:48:08.190452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.192076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:08.193963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:08.194096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:08.206148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 967/1927] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:08.211708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.214104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c8913-5e58-421c-bd9c-eae5b2aeef60 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.232429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e567e88-b8f3-4d27-a292-190048171ba1 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.240405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.242398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.245317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.245804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.246237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.246889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.247051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:08.247238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.248374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.249798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.249939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.252327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.261616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.292397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 968/1928] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:08.293810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.352271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 961/1929] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:08.352504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9be2-bbd1-4447-8561-b3d1a28c57b7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.353582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.464819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.465606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.465890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.466171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.466816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.471238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.471751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:08.501063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b182f-2592-4613-9492-e7c6c41b7473 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.513303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.514137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.514471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.514749 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.515737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.517805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.540307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 969/1930] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/projects => generated 365 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:08.544233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.555017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 962/1931] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/users => generated 304 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:08.561809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.574625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c1b5d-d82a-49e2-8f29-149055ad852a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.583477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:08.623045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf4eee-1c48-41ed-9fc4-f353d0d54ef1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.629184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.631416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.631581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.632074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.632956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.635069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.665534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.666172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.666673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.666794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.667494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.669013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.672560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 970/1932] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:08.676831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.689444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ea2f-bb28-467e-a7d9-edf5469150de admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.695517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 963/1933] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:08.695679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.696171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.696500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.696819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.697469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.699162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.699508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.711156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 971/1934] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:08.713155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b8cd3-d395-4530-be5b-1434fd8f036d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.715267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.718247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.719012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.719297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.719569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.720470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.723565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.727070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3c19-0073-4fb4-95fa-91cc5e2d44a7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.732656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.733327 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.733937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.734064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.734753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.736759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 964/1935] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:08.736907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.739473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.753425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ac5d-4397-4f20-be2e-9c6ad30c8a50 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.760860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 972/1936] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:08.765421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:08.771059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3b0c1-da79-4213-a618-c6fc410db4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.772695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3b0c1-da79-4213-a618-c6fc410db4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.772863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3b0c1-da79-4213-a618-c6fc410db4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.773758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3b0c1-da79-4213-a618-c6fc410db4e6 admin admin] PATH_INFO: `/v3/projects/e415c2a9294148ed98e554d85469274d/users/361e867d90dc4ef99ae489054f0238a5/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.783054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2d876-f283-420f-8ff5-4a36bfbacb7d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:08.792660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1e427-0d19-4a15-8ae6-b993907a42b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:08.794507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3b0c1-da79-4213-a618-c6fc410db4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e415c2a9294148ed98e554d85469274d, user_id=361e867d90dc4ef99ae489054f0238a5, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.795585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1e427-0d19-4a15-8ae6-b993907a42b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.795585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1e427-0d19-4a15-8ae6-b993907a42b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.795774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1e427-0d19-4a15-8ae6-b993907a42b1 admin admin] PATH_INFO: `/v3/projects/b9baaacf7559405d9905b030aaa67297/users/f6d85c90b4ef4e88aad45458c35d5c11/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.797801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3b0c1-da79-4213-a618-c6fc410db4e6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.813406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1e427-0d19-4a15-8ae6-b993907a42b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9baaacf7559405d9905b030aaa67297, user_id=f6d85c90b4ef4e88aad45458c35d5c11, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:08.816344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1e427-0d19-4a15-8ae6-b993907a42b1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:08.824812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 965/1937] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:08 2022] PUT /identity/v3/projects/e415c2a9294148ed98e554d85469274d/users/361e867d90dc4ef99ae489054f0238a5/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:08.827853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.828173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.828437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.855621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 973/1938] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:08 2022] PUT /identity/v3/projects/b9baaacf7559405d9905b030aaa67297/users/f6d85c90b4ef4e88aad45458c35d5c11/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:08.867610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:08.868058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:08.868058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:08.883047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] MFA Rules not processed for user `361e867d90dc4ef99ae489054f0238a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:08.884682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:08.902193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] MFA Rules not processed for user `f6d85c90b4ef4e88aad45458c35d5c11`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:08.904267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:08.985417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 966/1939] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:08.990961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.001177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 974/1940] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:09.006290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.027578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:09.076868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86da16-da5f-4a30-a595-0ccbecfbe46b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.077906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83229704-bdd1-40ab-a744-26ff727c07ff None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.081593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.082165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.083034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.083316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.083968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.084230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.085083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.085371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.085648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.086050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.086289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.088200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.112270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:09.140755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 967/1941] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:08 2022] POST /identity/v3/projects => generated 407 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:09.146961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.156401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 975/1942] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:09 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:09.160239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.236111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40186b-a44b-4ad2-8dc3-367cecacc1e8 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.250137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0dfb8-c2d8-4188-b0f5-f824a2925537 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.255755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.256372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.256652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.256979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.257624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.259640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.289375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 976/1943] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:09 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:09.293812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.307785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2943ac-e5a1-4ed0-a4d0-3a43a52f8fe5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.316597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.318041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.318365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.318813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.320113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.321839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.335760 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.336662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.336982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.337315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.338086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.340124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.347777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 977/1944] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:09.356552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.377563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03167-80d3-4bbf-b4df-f265f5a4047c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.387373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 968/1945] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:09 2022] POST /identity/v3/users => generated 310 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:09.392820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.393792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.394615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.394773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.408747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] PATH_INFO: `/v3/projects/535434a9cf414048803e419efb713bad/users/db722aef14be496abf14421a49f79c94/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.409237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760c083-c40a-470b-93a7-2bf47a3ccca2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.424824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.425660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.425851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.426120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.426957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.428917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.442692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=535434a9cf414048803e419efb713bad, user_id=db722aef14be496abf14421a49f79c94, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.451589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.457691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 969/1946] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:09.459756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.482538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 978/1947] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:09 2022] PUT /identity/v3/projects/535434a9cf414048803e419efb713bad/users/db722aef14be496abf14421a49f79c94/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:09.482672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5a488-da89-4417-b0b6-f259b831b8e4 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.489384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.587170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:09.617001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712b8c-6e53-4e63-bb92-043ed46e3e5f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.625002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.627804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.628096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.628379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.630098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.635365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.640494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.643122 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.643669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.644090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] PATH_INFO: `/v3/projects/1c9d250efacc4175a372c67f6da14b92/users/58aba0d633ce4387abe1549c8316f02a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.669649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 979/1948] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:09.672062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.689557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9d250efacc4175a372c67f6da14b92, user_id=58aba0d633ce4387abe1549c8316f02a, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.694466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.698222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe2a5-7010-4ca8-9156-69a4080cb55e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.708747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9d72-c39f-47a6-bd5c-2e4a779eda06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:09.713123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9d72-c39f-47a6-bd5c-2e4a779eda06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.715139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9d72-c39f-47a6-bd5c-2e4a779eda06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.715541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9d72-c39f-47a6-bd5c-2e4a779eda06 admin admin] PATH_INFO: `/v3/projects/535434a9cf414048803e419efb713bad/users/db722aef14be496abf14421a49f79c94/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.720055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9d72-c39f-47a6-bd5c-2e4a779eda06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535434a9cf414048803e419efb713bad, user_id=db722aef14be496abf14421a49f79c94, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:09.723877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 970/1949] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:09 2022] PUT /identity/v3/projects/1c9d250efacc4175a372c67f6da14b92/users/58aba0d633ce4387abe1549c8316f02a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:09.725376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9d72-c39f-47a6-bd5c-2e4a779eda06 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:09.727951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:09.769106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 980/1950] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:09 2022] PUT /identity/v3/projects/535434a9cf414048803e419efb713bad/users/db722aef14be496abf14421a49f79c94/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:09.793927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:09.794243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:09.794508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:09.834596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] MFA Rules not processed for user `db722aef14be496abf14421a49f79c94`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:09.835842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:09.853537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409965a-77d6-4b9b-acfe-1ace628f77e0 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:09.897279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:10.021673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 981/1951] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:10.039031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:10.041619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:10.048898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:10.049609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.049811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.056894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.057797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:10.063154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:10.101128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 971/1952] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:10.104065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:10.156063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bedb-5ecc-4732-866c-a46405c751cf admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:10.180853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38806292-5f51-442c-b465-0fe592c968f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:10.180853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38806292-5f51-442c-b465-0fe592c968f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.181128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38806292-5f51-442c-b465-0fe592c968f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.181214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38806292-5f51-442c-b465-0fe592c968f4 admin admin] PATH_INFO: `/v3/projects/1c9d250efacc4175a372c67f6da14b92/users/58aba0d633ce4387abe1549c8316f02a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.188861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38806292-5f51-442c-b465-0fe592c968f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9d250efacc4175a372c67f6da14b92, user_id=58aba0d633ce4387abe1549c8316f02a, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:10.190150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21755-8fa2-4e33-b93c-d925b31cde20 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:10.203572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:10.204639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.205149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.205651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.208117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38806292-5f51-442c-b465-0fe592c968f4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:10.227535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:10.229480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:10.252787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 972/1953] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:10 2022] PUT /identity/v3/projects/1c9d250efacc4175a372c67f6da14b92/users/58aba0d633ce4387abe1549c8316f02a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:10.257303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.257597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.257925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.259902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 982/1954] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:10.351397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] MFA Rules not processed for user `58aba0d633ce4387abe1549c8316f02a`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:10.352941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:10.443592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:10.445474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:10.454375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:10.475743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3dd4-0b1f-4e41-aa15-f2216da8b505 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:10.522342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 973/1955] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:10 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:10.548215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:10.574664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:10.575489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.575815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.576089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.614230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4cc5-50d8-4eb1-b978-2f046d1990ed None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:10.618310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:10.618942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.619225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.619501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.629181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:10.631374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:10.639822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:10.641202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:10.643684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 974/1956] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:10.652594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 983/1957] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:10.875974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:10.888963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cedde-1c57-4be6-8e52-d51a58a3ccbd service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:10.902529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2911-05e9-445b-8372-204620949443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:10.903237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2911-05e9-445b-8372-204620949443 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:10.904027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2911-05e9-445b-8372-204620949443 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:10.904305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2911-05e9-445b-8372-204620949443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:10.978902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2911-05e9-445b-8372-204620949443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:10.980484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b2911-05e9-445b-8372-204620949443 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:10.991549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 975/1958] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:10 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:16.265393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:16.276601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:16.353031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd7e4-893a-49c7-b5a5-f18d6ca2f2ae service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:16.360402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:16.361091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:16.361375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:16.361653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] PATH_INFO: `/v3/users/f6d85c90b4ef4e88aad45458c35d5c11` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:16.363015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d85c90b4ef4e88aad45458c35d5c11)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:16.365195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:16.422953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d85c90b4ef4e88aad45458c35d5c11'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.423705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d85c90b4ef4e88aad45458c35d5c11'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.433312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d85c90b4ef4e88aad45458c35d5c11'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.435047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d85c90b4ef4e88aad45458c35d5c11'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.448099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d85c90b4ef4e88aad45458c35d5c11'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.474352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 984/1959] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:16 2022] DELETE /identity/v3/users/f6d85c90b4ef4e88aad45458c35d5c11 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:16.479726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:16.480165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:16.480292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:16.505492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:16.506847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:16.593414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 976/1960] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:16.604317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:16.605999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:16.617701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:16.621399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:16.637547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaeaab-946d-45fd-8f24-cebd2039aa09 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:16.650626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:16.650923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:16.651195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:16.651466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] PATH_INFO: `/v3/users/c0b36791891b44939bea19d8594fc4f4` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:16.652762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b36791891b44939bea19d8594fc4f4)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:16.654860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:16.672588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:16.695655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344aa65-e9b9-4126-bcb9-6f00f9428d81 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:16.701789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91524-9445-4bab-924f-2fa0ec1d655c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:16.702524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91524-9445-4bab-924f-2fa0ec1d655c service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:16.702873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91524-9445-4bab-924f-2fa0ec1d655c service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:16.703218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91524-9445-4bab-924f-2fa0ec1d655c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:16.714578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91524-9445-4bab-924f-2fa0ec1d655c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:16.716486 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91524-9445-4bab-924f-2fa0ec1d655c service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:16.721957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b36791891b44939bea19d8594fc4f4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.723088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b36791891b44939bea19d8594fc4f4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.730604 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 985/1961] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:16.731752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b36791891b44939bea19d8594fc4f4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.742142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b36791891b44939bea19d8594fc4f4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.743197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b36791891b44939bea19d8594fc4f4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:16.767851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 977/1962] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:16 2022] DELETE /identity/v3/users/c0b36791891b44939bea19d8594fc4f4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:16.774533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:16.774815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:16.774956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:16.797010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:16.798552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:16.855714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:16.945402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 986/1963] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:16.955556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:16.957150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.063569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd14e1c-b33a-4a2e-a69e-6a39987c90f9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.068983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.070341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.070634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.070911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.086701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.088339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.106950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 978/1964] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:17.184484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:17.187438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.206138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc00568-5731-4eb3-b6b3-d3fbcf1522c3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.222046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.222835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.223350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.223900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] PATH_INFO: `/v3/users/361e867d90dc4ef99ae489054f0238a5` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.225227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361e867d90dc4ef99ae489054f0238a5)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.227403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.227706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:17.229563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.261858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226bc4d-520a-45b1-89fc-36f13f7032e4 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.284071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.285012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.285766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.285766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] PATH_INFO: `/v3/projects/b9baaacf7559405d9905b030aaa67297` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.287479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9baaacf7559405d9905b030aaa67297)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.290918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.308184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361e867d90dc4ef99ae489054f0238a5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.308916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361e867d90dc4ef99ae489054f0238a5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.318715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361e867d90dc4ef99ae489054f0238a5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.319548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361e867d90dc4ef99ae489054f0238a5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.330440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b5713f3f-57f9-45e5-8778-1e53d96214f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361e867d90dc4ef99ae489054f0238a5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.357142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 987/1965] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:17 2022] DELETE /identity/v3/users/361e867d90dc4ef99ae489054f0238a5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:17.361302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.361527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9baaacf7559405d9905b030aaa67297', 'request_id': 'req-d0e328fc-ac76-43c8-82a0-0664c3100ae2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.361696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.361855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.372777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9baaacf7559405d9905b030aaa67297', 'request_id': 'req-d0e328fc-ac76-43c8-82a0-0664c3100ae2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.380919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9baaacf7559405d9905b030aaa67297', 'request_id': 'req-d0e328fc-ac76-43c8-82a0-0664c3100ae2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.390148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:17.391057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.405028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] The token cache is being invalidate because project b9baaacf7559405d9905b030aaa67297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:17.405332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.406377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.413496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 979/1966] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:17 2022] DELETE /identity/v3/projects/b9baaacf7559405d9905b030aaa67297 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:17.414454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:17.416399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.446269 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:17.484402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 988/1967] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:17.496334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:17.498004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.513023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e328fc-ac76-43c8-82a0-0664c3100ae2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.518546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.519283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.519647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.519928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] PATH_INFO: `/v3/users/db722aef14be496abf14421a49f79c94` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.521356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db722aef14be496abf14421a49f79c94)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.524364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.563311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:17.588524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa2cc3-2f8b-4b88-baa2-ede4c4742b2d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.599117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.599795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.600081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.600409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.601726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db722aef14be496abf14421a49f79c94'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.602383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db722aef14be496abf14421a49f79c94'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.613107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.615272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.619474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db722aef14be496abf14421a49f79c94'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.625851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 989/1968] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:17.626897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:17.628571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.634204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db722aef14be496abf14421a49f79c94'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.634926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db722aef14be496abf14421a49f79c94'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.642182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceafc9-8c4a-488f-8c44-a650aca39c60 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.652331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.653205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.653488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.653764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] PATH_INFO: `/v3/projects/fa98adb5889e486caedf13b039f4f920` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.654934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa98adb5889e486caedf13b039f4f920)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.656995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.658726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 980/1969] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:17 2022] DELETE /identity/v3/users/db722aef14be496abf14421a49f79c94 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:17.723518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa98adb5889e486caedf13b039f4f920', 'request_id': 'req-0fff0a3f-defd-4553-bcac-59a0ac7239ae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.732611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa98adb5889e486caedf13b039f4f920', 'request_id': 'req-0fff0a3f-defd-4553-bcac-59a0ac7239ae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.744224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa98adb5889e486caedf13b039f4f920', 'request_id': 'req-0fff0a3f-defd-4553-bcac-59a0ac7239ae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.759438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] The token cache is being invalidate because project fa98adb5889e486caedf13b039f4f920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:17.759438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.760256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:17.762294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 990/1970] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:17 2022] DELETE /identity/v3/projects/fa98adb5889e486caedf13b039f4f920 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:17.766079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:17.767520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:17.860012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2603295-e63f-449e-95bb-76d708df2b55 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:17.921761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:17.945691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:17.946625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:17.946625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:17.946903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] PATH_INFO: `/v3/users/ddc66a910e824383bf8382da2caaa5bc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:17.948352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc66a910e824383bf8382da2caaa5bc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:17.950454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:17.998262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.001062 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:18.052568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff0a3f-defd-4553-bcac-59a0ac7239ae admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.056478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc66a910e824383bf8382da2caaa5bc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.061487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc66a910e824383bf8382da2caaa5bc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.071995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.073471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.074284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.074574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] PATH_INFO: `/v3/projects/535434a9cf414048803e419efb713bad` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.075713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc66a910e824383bf8382da2caaa5bc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.077261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=535434a9cf414048803e419efb713bad)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.091618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.091944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc66a910e824383bf8382da2caaa5bc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.091944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2b284e0c-c2b7-429f-9005-b9102e77bf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc66a910e824383bf8382da2caaa5bc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.124638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 981/1971] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:17 2022] DELETE /identity/v3/users/ddc66a910e824383bf8382da2caaa5bc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:18.189579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535434a9cf414048803e419efb713bad', 'request_id': 'req-f620a8c7-4e6b-4359-8f77-33d29de601ef'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.197567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535434a9cf414048803e419efb713bad', 'request_id': 'req-f620a8c7-4e6b-4359-8f77-33d29de601ef'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.208985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535434a9cf414048803e419efb713bad', 'request_id': 'req-f620a8c7-4e6b-4359-8f77-33d29de601ef'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.221873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] The token cache is being invalidate because project 535434a9cf414048803e419efb713bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:18.222171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.223129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f620a8c7-4e6b-4359-8f77-33d29de601ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.225216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 991/1972] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:17 2022] DELETE /identity/v3/projects/535434a9cf414048803e419efb713bad => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:18.230054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.231297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.232027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.260391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:18.261969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:18.368682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 982/1973] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:18.370492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.371032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.371125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.393829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:18.396325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:18.408592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 992/1974] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:18.409823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.436851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5839-975d-4bfb-890a-d3b38bd02742 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.443019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.443840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.444347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.445007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.445962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:18.446340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.448337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.465842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 983/1975] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:18.468938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.477556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.480620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:18.481777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2119-72f1-489f-9606-b62b9e98dba5 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.487756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.490351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.490708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.491047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.492429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.495102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.497112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434ab44-d005-406f-9ad1-e1b07fd6e8f9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.509065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.510755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.511113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.512147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] PATH_INFO: `/v3/projects/e415c2a9294148ed98e554d85469274d` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.514334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e415c2a9294148ed98e554d85469274d)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.542514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 993/1976] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:18 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:18.543466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.548892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.614829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:18.656939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:18.664733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e415c2a9294148ed98e554d85469274d', 'request_id': 'req-318df559-d9c7-4443-b76e-8e01f72101c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.682381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e415c2a9294148ed98e554d85469274d', 'request_id': 'req-318df559-d9c7-4443-b76e-8e01f72101c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.697069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e415c2a9294148ed98e554d85469274d', 'request_id': 'req-318df559-d9c7-4443-b76e-8e01f72101c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.718352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df156cf-601f-4501-9c51-ab3883ea939c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.729526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] The token cache is being invalidate because project e415c2a9294148ed98e554d85469274d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:18.729860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.730630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:18.733420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 984/1977] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:18 2022] DELETE /identity/v3/projects/e415c2a9294148ed98e554d85469274d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:18.737833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.741340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:18.843118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.843751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.844215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.844616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.845709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.855205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.885660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 994/1978] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:18 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:18.890931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.892888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:18.916086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb189ff-91f5-40c9-a5db-2f80d4ec8abd admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.927276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.928238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.928619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.929144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.929870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.930515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318df559-d9c7-4443-b76e-8e01f72101c2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.932227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.944311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.945039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.945352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.945633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] PATH_INFO: `/v3/users/58aba0d633ce4387abe1549c8316f02a` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.949515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aba0d633ce4387abe1549c8316f02a)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.951740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 995/1979] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:18.952692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:18.952847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:18.967532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a568e1-ce77-4652-91bb-a52e6f1225e9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:18.978988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:18.980110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:18.980599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:18.981589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:18.982821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:18.985169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.001041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 996/1980] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:19.005930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.023609 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df8a05-d921-4c0b-b37c-cddeeee6f59b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.053468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aba0d633ce4387abe1549c8316f02a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.054441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.055435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aba0d633ce4387abe1549c8316f02a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.055979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.057320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.058366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] PATH_INFO: `/v3/projects/fbb85ade581b4cdba79346d0ad59af77/users/a54c8943cbe24be2bbea3f418013873b/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.075887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aba0d633ce4387abe1549c8316f02a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.093556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aba0d633ce4387abe1549c8316f02a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.094490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e4cd8f0e-10b9-4fd4-9e01-09e22975f524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aba0d633ce4387abe1549c8316f02a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.103318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb85ade581b4cdba79346d0ad59af77, user_id=a54c8943cbe24be2bbea3f418013873b, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.106118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.154335 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 997/1981] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:19 2022] PUT /identity/v3/projects/fbb85ade581b4cdba79346d0ad59af77/users/a54c8943cbe24be2bbea3f418013873b/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:19.155561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.157928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 985/1982] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:18 2022] DELETE /identity/v3/users/58aba0d633ce4387abe1549c8316f02a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:19.161853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.167123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.169176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.169630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.219878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] MFA Rules not processed for user `a54c8943cbe24be2bbea3f418013873b`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:19.221754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.319059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:19.324267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d624ae-0bd5-4d26-a275-b2501df8ae9c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.355325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 986/1983] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:19.371434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.373220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.396612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:19.448645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.449232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.449522 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.449785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] PATH_INFO: `/v3/projects/97b71cb48ed14a5f97c597d9e97582d7` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.451172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b71cb48ed14a5f97c597d9e97582d7)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.453544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.497831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7eb0-8270-464e-81bc-6b1c94ff98e0 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.505962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.506709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.507523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.507935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.508796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.512041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.543123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b71cb48ed14a5f97c597d9e97582d7', 'request_id': 'req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.552816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 987/1984] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:19.553338 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b71cb48ed14a5f97c597d9e97582d7', 'request_id': 'req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.557648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.565765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b71cb48ed14a5f97c597d9e97582d7', 'request_id': 'req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.582484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] The token cache is being invalidate because project 97b71cb48ed14a5f97c597d9e97582d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:19.582484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.583027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-4c084b99-6d1b-4756-b5e8-8ea8de15eb04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.585088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 998/1985] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:19 2022] DELETE /identity/v3/projects/97b71cb48ed14a5f97c597d9e97582d7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:19.592686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.592686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.592957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.616685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:19.618138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.667365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bcd9b-6e64-4047-942e-e11a9d27e2d7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.674459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.675262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.676327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.676813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.677625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.680301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.718748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 988/1986] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:19.718748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.718748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.732152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2ae22-a9d9-4d56-9950-3d882fbc7feb admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.737366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 999/1987] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:19.738902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.739810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.741203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.742668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.743158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] PATH_INFO: `/v3/projects/1c9d250efacc4175a372c67f6da14b92` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.743278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.745814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9d250efacc4175a372c67f6da14b92)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.748004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.756528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5eac7-7a0f-476b-a2b6-7aa54196e800 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.761755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de127-6634-4fdf-a238-2eb737b3771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.762402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de127-6634-4fdf-a238-2eb737b3771e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.762678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de127-6634-4fdf-a238-2eb737b3771e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.762955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de127-6634-4fdf-a238-2eb737b3771e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.763601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5de127-6634-4fdf-a238-2eb737b3771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.765564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5de127-6634-4fdf-a238-2eb737b3771e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.791829 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1000/1988] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:19.793104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1095-4689-401e-85db-b79e719f1cf0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.793401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1095-4689-401e-85db-b79e719f1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.793685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1095-4689-401e-85db-b79e719f1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.824365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-280a1095-4689-401e-85db-b79e719f1cf0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:19.824567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9d250efacc4175a372c67f6da14b92', 'request_id': 'req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.825642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-280a1095-4689-401e-85db-b79e719f1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.828388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:19.836308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9d250efacc4175a372c67f6da14b92', 'request_id': 'req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.848680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9d250efacc4175a372c67f6da14b92', 'request_id': 'req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.872862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] The token cache is being invalidate because project 1c9d250efacc4175a372c67f6da14b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:19.872862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.872862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:19.872862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 989/1989] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:19 2022] DELETE /identity/v3/projects/1c9d250efacc4175a372c67f6da14b92 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:19.872862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.873708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.890112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:19.919439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1001/1990] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:19.921025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.921311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.921587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.942767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:19.944053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:19.952176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1002/1991] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:19.952938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:19.960665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6a81a-0016-46ea-bf43-e020cf0f4ee2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.963391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43701a-cf9d-46fe-8533-95e7d3142df6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:19.965907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.966629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.966910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.967181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] PATH_INFO: `/v3/projects/2df9a6263bd941f38f64093df45a7843/users/bc3c2745530343009a64cd08e0bb1af7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.968091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:19.968690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.969008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.969280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.969925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:19.970502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.972122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2e521-9ef4-4798-8314-8727cc23f8bc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:19.983534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df9a6263bd941f38f64093df45a7843, user_id=bc3c2745530343009a64cd08e0bb1af7, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:19.984344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1003/1992] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:19.985610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:19.985897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:19.986170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:19.986954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.001279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 990/1993] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:19 2022] PUT /identity/v3/projects/2df9a6263bd941f38f64093df45a7843/users/bc3c2745530343009a64cd08e0bb1af7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:20.005035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.007804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:20.009012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:20.071306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b04c5e-1a20-4595-aad9-01850c5a403f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.073389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1004/1994] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:20.074237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.079439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.080057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.080334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.080599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.081257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.083699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.084653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e31ae-5e11-4fd8-85c7-6a3d8d9927e6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.097172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.098378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.098874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.099209 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.099870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.102070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.115388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1005/1995] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:20.117106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.130411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 991/1996] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:20.131873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.134679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f5ded-a432-4c35-89ab-395f3272d573 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.187179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:20.205998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4d152-01c7-4167-930b-96e550e694fc admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.211808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.212490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.212801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.213081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] PATH_INFO: `/v3/projects/2df9a6263bd941f38f64093df45a7843/users/bc3c2745530343009a64cd08e0bb1af7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.215070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df9a6263bd941f38f64093df45a7843, user_id=bc3c2745530343009a64cd08e0bb1af7, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.216355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.218673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.219767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.220529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.221611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.222497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:20.222873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.224530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6e05-e284-4ca6-a515-4d87b915915d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.231988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 992/1997] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:20 2022] PUT /identity/v3/projects/2df9a6263bd941f38f64093df45a7843/users/bc3c2745530343009a64cd08e0bb1af7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:20.232859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.243468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1006/1998] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:20.245133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.245731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.246181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.279515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] MFA Rules not processed for user `bc3c2745530343009a64cd08e0bb1af7`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:20.281190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:20.323910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd42753-2eee-45c9-b83e-909575d274b1 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.332618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.334904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.335274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.335541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.336166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.338023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:20.338796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.365055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 993/1999] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:20.369404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.389178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1007/2000] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:20.390663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.390787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0a592-f2d3-442b-8aa9-c4bacb2ad198 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.401236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.401860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.402138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.402419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.403712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.404079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419cf25-75e2-464e-8804-b35c43ef7534 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.405682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.408817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.411516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.412003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.412284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.412982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.414780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.426284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1008/2001] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:20.427310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.429111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:20.437507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 994/2002] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:20.438208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.493286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bff00a-b921-4f50-98d8-47e63fcb0fce admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.503498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea89a9-88c5-42ab-a2d6-019bab7a8888 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.509015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.509640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.509925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.510205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.510852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.512448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.523203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 995/2003] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:20.524111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.534022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf62cd2-9921-4f87-893d-4ca96f6c29b8 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.538995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.539587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.539862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.540132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.540813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.542700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.544065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b8ff-5919-4287-89fe-070914f32076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.544673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b8ff-5919-4287-89fe-070914f32076 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.545004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b8ff-5919-4287-89fe-070914f32076 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.545298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b8ff-5919-4287-89fe-070914f32076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.568786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 996/2004] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:20.568786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.576286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7c15-7da5-4fe1-b08a-9577fa462fd0 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.581103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.581744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.582125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.582400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] PATH_INFO: `/v3/projects/f6fe08babb8f4eb8b08d56547598d6fe/users/342a823a515d43cb89ff325b738f9633/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.598219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe08babb8f4eb8b08d56547598d6fe, user_id=342a823a515d43cb89ff325b738f9633, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.601529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.613031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b8ff-5919-4287-89fe-070914f32076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.614443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 997/2005] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:20 2022] PUT /identity/v3/projects/f6fe08babb8f4eb8b08d56547598d6fe/users/342a823a515d43cb89ff325b738f9633/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:20.615239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.620316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:20.623351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b8ff-5919-4287-89fe-070914f32076 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.634170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1009/2006] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:20.637314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee67393-8217-4489-9c39-547e07ef533e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.637598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee67393-8217-4489-9c39-547e07ef533e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.637873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee67393-8217-4489-9c39-547e07ef533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.678316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-aee67393-8217-4489-9c39-547e07ef533e None None] MFA Rules not processed for user `342a823a515d43cb89ff325b738f9633`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:20.679815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aee67393-8217-4489-9c39-547e07ef533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:20.697681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad230b-f5d0-46c6-b8ae-c0d58b9f11d9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.703545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.704254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.704604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.704983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.705810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:20.707727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.709588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.722975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 998/2007] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:20.726571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.739130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e93a-157b-474a-ab49-02a8f279f568 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.744702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.745478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.745836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.746179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.746899 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.748977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.764679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 999/2008] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:20.767094 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.781474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8addf4-2285-4e0b-aca1-9567586fc90b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.789883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d4a24-80ce-44a2-831d-a694c30bf160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.790849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d4a24-80ce-44a2-831d-a694c30bf160 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.792959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d4a24-80ce-44a2-831d-a694c30bf160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.793280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d4a24-80ce-44a2-831d-a694c30bf160 admin admin] PATH_INFO: `/v3/projects/67543d086f4747c9ae2496585876394d/users/8113c4a291ba490bb6d321abf9931926/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.797034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1010/2009] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:20.797955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee67393-8217-4489-9c39-547e07ef533e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.811841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d4a24-80ce-44a2-831d-a694c30bf160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67543d086f4747c9ae2496585876394d, user_id=8113c4a291ba490bb6d321abf9931926, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.813891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee67393-8217-4489-9c39-547e07ef533e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.814949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d4a24-80ce-44a2-831d-a694c30bf160 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.819565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.820474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.821010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.821484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.822398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.824379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.841856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1000/2010] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:20 2022] PUT /identity/v3/projects/67543d086f4747c9ae2496585876394d/users/8113c4a291ba490bb6d321abf9931926/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:20.843330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.843768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.844049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.875192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1011/2011] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:20.876266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:20.900564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:20.900564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:20.958565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2590f-6f9f-413a-8aea-edec3d168f1a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:20.965336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:20.966050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:20.966479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:20.966696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:20.967690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:20.970321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:20.990063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1001/2012] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:21.001911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.003684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:21.005180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1012/2013] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:20 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:21.009934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.022491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785beaf7-b5b6-4d22-b44d-28179c8ce9af admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.027441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.028125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.028435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.028857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.029448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.031234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.047651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1013/2014] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:21.048482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.059294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1908f1-b1d9-4994-902b-b6c055b81cea admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.065087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.065811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.066095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.066415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] PATH_INFO: `/v3/projects/48889798b4f5421883de37d40a9d0edc/users/334f3ede607a4c31b31e5e443f870f3f/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.094315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48889798b4f5421883de37d40a9d0edc, user_id=334f3ede607a4c31b31e5e443f870f3f, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.094785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d0f3b-a99b-4a16-865e-08fb1c20f22d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.098443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.100245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.100846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.101131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.101407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.119031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.121940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.127699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1014/2015] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:21 2022] PUT /identity/v3/projects/48889798b4f5421883de37d40a9d0edc/users/334f3ede607a4c31b31e5e443f870f3f/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:21.131864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.137649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1002/2016] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:21.209180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:21.241814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192980df-e765-4073-969f-4661c9d863c9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.246959 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac02efa-4d01-4f69-b2da-a036e7786964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.247592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02efa-4d01-4f69-b2da-a036e7786964 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.247870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02efa-4d01-4f69-b2da-a036e7786964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.248148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac02efa-4d01-4f69-b2da-a036e7786964 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.248948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02efa-4d01-4f69-b2da-a036e7786964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.250591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac02efa-4d01-4f69-b2da-a036e7786964 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.266586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1015/2017] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:21.268021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.296360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c80fe-60e4-4b5c-827e-3567690161a2 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.313149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.314256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.314617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.314961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] PATH_INFO: `/v3/projects/48889798b4f5421883de37d40a9d0edc/users/334f3ede607a4c31b31e5e443f870f3f/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.317540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=48889798b4f5421883de37d40a9d0edc, user_id=334f3ede607a4c31b31e5e443f870f3f, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.320766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.326240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:21.352385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1003/2018] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:21 2022] PUT /identity/v3/projects/48889798b4f5421883de37d40a9d0edc/users/334f3ede607a4c31b31e5e443f870f3f/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:21.357422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.357714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.357997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.400432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] MFA Rules not processed for user `334f3ede607a4c31b31e5e443f870f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:21.401812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:21.518791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1016/2019] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:21.524968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.533700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.536033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:21.622996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4b812-809d-471e-ac5b-cd4ac8e3de99 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.627271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.629375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.630304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.631463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.634034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e492b4-18c6-4468-8579-ef4fdb36e2cd admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.640928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.641778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.643266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.643697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] PATH_INFO: `/v3/users/a54c8943cbe24be2bbea3f418013873b` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.643828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.645735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54c8943cbe24be2bbea3f418013873b)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.646157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.648230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.662365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1017/2020] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:21.714547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.720856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54c8943cbe24be2bbea3f418013873b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.721738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54c8943cbe24be2bbea3f418013873b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.727167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038380f-00bc-463e-bd94-4d15a7e2d62a service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:21.733650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:21.734108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.734396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.734743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] PATH_INFO: `/v3/users/342a823a515d43cb89ff325b738f9633` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.736161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=342a823a515d43cb89ff325b738f9633)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:21.738256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:21.739623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54c8943cbe24be2bbea3f418013873b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.750422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54c8943cbe24be2bbea3f418013873b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.753090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1568fe38-4ca4-43e7-beb6-67797525df91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54c8943cbe24be2bbea3f418013873b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.781669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1004/2021] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:21 2022] DELETE /identity/v3/users/a54c8943cbe24be2bbea3f418013873b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:21.786598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.789001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.791155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.803986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342a823a515d43cb89ff325b738f9633'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.804365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342a823a515d43cb89ff325b738f9633'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.815442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342a823a515d43cb89ff325b738f9633'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.818141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342a823a515d43cb89ff325b738f9633'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.825393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:21.827544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:21.828076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-12499b2d-3749-4791-9058-88f8ae2dfb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342a823a515d43cb89ff325b738f9633'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:21.835381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:21.866582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1018/2022] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:21 2022] DELETE /identity/v3/users/342a823a515d43cb89ff325b738f9633 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:21.871374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:21.871805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:21.872751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:21.904926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:21.909494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:21.918550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1005/2023] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:21.932891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:21.934308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:21.954126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:21.998204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1019/2024] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:22.008909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.013088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32920ef0-e0e9-43e8-8757-b0596abd9532 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.070213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b209-9bf8-4806-a3d4-eab81cbbac9b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.075078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa268501-597e-4b30-bb61-d23ed42122de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.075814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268501-597e-4b30-bb61-d23ed42122de service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.076582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268501-597e-4b30-bb61-d23ed42122de service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.076582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268501-597e-4b30-bb61-d23ed42122de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.084153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.084927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.086034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.086319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.088050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa268501-597e-4b30-bb61-d23ed42122de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.089915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa268501-597e-4b30-bb61-d23ed42122de service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.101293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.102381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1020/2025] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:22.103574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.115593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1006/2026] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:22.142087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.142454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.142798 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.176248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] MFA Rules not processed for user `8113c4a291ba490bb6d321abf9931926`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:22.178561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:22.266852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1021/2027] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:22.272135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.273982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:22.289843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dda45-4c62-4ef7-bf61-0c61f306bd6f service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.295740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.296808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.297174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.297527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.298310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.300472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.331950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1007/2028] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:22 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:22.337031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.352046 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3009ad4-241f-4aad-8a1e-e0b7092944e7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.373611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:22.445949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.446941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.447295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.447810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.448691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.450780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.486812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1022/2029] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:22 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:22.490807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.514732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a0670-3875-49cb-95a9-032d92555f85 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.527383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.528343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.529416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.529890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.530902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.540546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.555369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1008/2030] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:22.561843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.573940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f2d5-1c13-4840-92e0-a490ca8c07f3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.579188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.579858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.580143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.580423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] PATH_INFO: `/v3/projects/fdee197735434f5588c428879efd7884/users/36a9639fcb424e7fb25630b646fb89c8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.585307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.587761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:22.601712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24dec6-3ca8-442c-96f8-af5ae8b4fcf7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.611680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee197735434f5588c428879efd7884, user_id=36a9639fcb424e7fb25630b646fb89c8, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.618415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.618879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.619218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.619546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.619887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] PATH_INFO: `/v3/projects/f6fe08babb8f4eb8b08d56547598d6fe` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.621178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6fe08babb8f4eb8b08d56547598d6fe)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.623494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.639249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1023/2031] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:22 2022] PUT /identity/v3/projects/fdee197735434f5588c428879efd7884/users/36a9639fcb424e7fb25630b646fb89c8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:22.645270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.689206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6fe08babb8f4eb8b08d56547598d6fe', 'request_id': 'req-6e8f1b65-2d4b-425d-8559-cd7fa172abca'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.698252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6fe08babb8f4eb8b08d56547598d6fe', 'request_id': 'req-6e8f1b65-2d4b-425d-8559-cd7fa172abca'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.708261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6fe08babb8f4eb8b08d56547598d6fe', 'request_id': 'req-6e8f1b65-2d4b-425d-8559-cd7fa172abca'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.724628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] The token cache is being invalidate because project f6fe08babb8f4eb8b08d56547598d6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:22.725289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.726189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.729889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1009/2032] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:22 2022] DELETE /identity/v3/projects/f6fe08babb8f4eb8b08d56547598d6fe => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:22.731009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.733037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:22.736808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bb887-0e4e-42b8-aa19-1ecd570f2f4c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.784175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:22.811923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.812738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.813023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.813722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.814680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.817156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.830453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1024/2033] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:22.831271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.834641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:22.847284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f1b65-2d4b-425d-8559-cd7fa172abca admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.849825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6be6-4faf-4eff-a0aa-d21c4846c280 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:22.853139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.853972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.854362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.854734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] PATH_INFO: `/v3/projects/fbb85ade581b4cdba79346d0ad59af77` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.855898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:22.856488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:22.856488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:22.856813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] PATH_INFO: `/v3/users/334f3ede607a4c31b31e5e443f870f3f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:22.857202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb85ade581b4cdba79346d0ad59af77)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.858098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334f3ede607a4c31b31e5e443f870f3f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:22.860610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.860787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:22.889723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:22.924291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334f3ede607a4c31b31e5e443f870f3f'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.925524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334f3ede607a4c31b31e5e443f870f3f'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.929153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb85ade581b4cdba79346d0ad59af77', 'request_id': 'req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.936102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334f3ede607a4c31b31e5e443f870f3f'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.936994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334f3ede607a4c31b31e5e443f870f3f'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.938307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb85ade581b4cdba79346d0ad59af77', 'request_id': 'req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.946592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334f3ede607a4c31b31e5e443f870f3f'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.949556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb85ade581b4cdba79346d0ad59af77', 'request_id': 'req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.963753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] The token cache is being invalidate because project fbb85ade581b4cdba79346d0ad59af77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:22.964050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.964758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:22.966322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1010/2034] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:22 2022] DELETE /identity/v3/projects/fbb85ade581b4cdba79346d0ad59af77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:22.967064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.968477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:22.972839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1025/2035] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:22 2022] DELETE /identity/v3/users/334f3ede607a4c31b31e5e443f870f3f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:22.974121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:22.975606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:23.048419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e9d5-9c3e-4ca1-8082-b5ff9c67d054 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:23.055048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:23.055729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:23.056010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:23.056285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] PATH_INFO: `/v3/projects/fdee197735434f5588c428879efd7884/users/36a9639fcb424e7fb25630b646fb89c8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:23.058473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee197735434f5588c428879efd7884, user_id=36a9639fcb424e7fb25630b646fb89c8, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:23.058934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf642f78-3688-4a1e-9880-90dc0ebb2369 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:23.061041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:23.068273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:23.070040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:23.070659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:23.071326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] PATH_INFO: `/v3/users/bc3c2745530343009a64cd08e0bb1af7` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:23.072643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1011/2036] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:22 2022] PUT /identity/v3/projects/fdee197735434f5588c428879efd7884/users/36a9639fcb424e7fb25630b646fb89c8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:23.077068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3c2745530343009a64cd08e0bb1af7)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:23.079639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:23.145949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3c2745530343009a64cd08e0bb1af7'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:23.146721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3c2745530343009a64cd08e0bb1af7'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:23.156977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3c2745530343009a64cd08e0bb1af7'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:23.157876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3c2745530343009a64cd08e0bb1af7'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:23.168995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3c2745530343009a64cd08e0bb1af7'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:23.209235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1026/2037] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:22 2022] DELETE /identity/v3/users/bc3c2745530343009a64cd08e0bb1af7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:23.770538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:23.773908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:23.854570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:23.875589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948c20-6c0a-4480-b0bf-113b8c58103c admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:23.962147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:23.962866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:23.963141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:23.963404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] PATH_INFO: `/v3/projects/2df9a6263bd941f38f64093df45a7843` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:23.964822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df9a6263bd941f38f64093df45a7843)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:23.967813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.005858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.008820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.031660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdbad-77df-4fe1-8436-1ee3c204b7a0 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.035844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df9a6263bd941f38f64093df45a7843', 'request_id': 'req-5d0d0f00-9211-4037-8685-03b1564cca70'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.046178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df9a6263bd941f38f64093df45a7843', 'request_id': 'req-5d0d0f00-9211-4037-8685-03b1564cca70'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.055593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df9a6263bd941f38f64093df45a7843', 'request_id': 'req-5d0d0f00-9211-4037-8685-03b1564cca70'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.056381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:24.074796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] The token cache is being invalidate because project 2df9a6263bd941f38f64093df45a7843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:24.075127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.075940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d0d0f00-9211-4037-8685-03b1564cca70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.083319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1012/2038] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:23 2022] DELETE /identity/v3/projects/2df9a6263bd941f38f64093df45a7843 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:24.084776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354debd4-4f69-4d08-b811-f4c3fab7372a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.085126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354debd4-4f69-4d08-b811-f4c3fab7372a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.085494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354debd4-4f69-4d08-b811-f4c3fab7372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.109711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-354debd4-4f69-4d08-b811-f4c3fab7372a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:24.111175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-354debd4-4f69-4d08-b811-f4c3fab7372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.158194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.159137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.159271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.159596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] PATH_INFO: `/v3/projects/48889798b4f5421883de37d40a9d0edc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.161699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48889798b4f5421883de37d40a9d0edc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.163765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.197164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1013/2039] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:24.209444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.209797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.210077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.230064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48889798b4f5421883de37d40a9d0edc', 'request_id': 'req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.232118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:24.233407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.238261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48889798b4f5421883de37d40a9d0edc', 'request_id': 'req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.249729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48889798b4f5421883de37d40a9d0edc', 'request_id': 'req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.266503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:24.267553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] The token cache is being invalidate because project 48889798b4f5421883de37d40a9d0edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:24.267943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.268668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-8e7aa2bb-7b67-4a11-8c41-c09d6d7884d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:24.274318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1027/2040] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:24 2022] DELETE /identity/v3/projects/48889798b4f5421883de37d40a9d0edc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:24.276403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7761db-d650-414b-a819-37abf3cd16ac None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.277389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7761db-d650-414b-a819-37abf3cd16ac None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.277744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7761db-d650-414b-a819-37abf3cd16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.301310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3d7761db-d650-414b-a819-37abf3cd16ac None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:24.302797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3d7761db-d650-414b-a819-37abf3cd16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.329020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1014/2041] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:24.333857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.344209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b1d2f-0b47-44a8-93f2-950288fe2d6f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.351406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.352020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.352305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.352584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.353302 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:24.353608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.355283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.388058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1015/2042] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:48:24.392389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.400992 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1028/2043] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:24.405777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.406276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.406737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.407133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0555e-2ef5-46df-be09-4ff7dc6ee482 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.412290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.412930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.413257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.413533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.414171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.416095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.433744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:24.435075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.451055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1029/2044] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:24.455599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.460031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1016/2045] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:24.465027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.480440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1edd-6b2e-4b0d-9e69-fc6275158139 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.533601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:24.560165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4c4ba-5e83-4482-87af-75343932888f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.567664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8fcbc-aaf5-41a1-a3d6-b5e1b8730f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.568554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8fcbc-aaf5-41a1-a3d6-b5e1b8730f08 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.568875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8fcbc-aaf5-41a1-a3d6-b5e1b8730f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.569210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8fcbc-aaf5-41a1-a3d6-b5e1b8730f08 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.569860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8fcbc-aaf5-41a1-a3d6-b5e1b8730f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.572089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8fcbc-aaf5-41a1-a3d6-b5e1b8730f08 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.575302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.576993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.577273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.577546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.578512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:24.578821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.580598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.608467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1017/2046] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:24.610240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.610764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.611459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.648258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1030/2047] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:24.651304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.667386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58d0b3-6c77-4cbb-a3ca-e68025830860 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.673816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.674667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.675047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.675515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.676843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.678586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.679389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] MFA Rules not processed for user `36a9639fcb424e7fb25630b646fb89c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:24.682590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.694677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1031/2048] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:24.694677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.706459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff14d7-7b4c-4dc0-bb53-9b850da0f6f3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.716216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.716866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.717204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.717618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.718267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.720471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.783530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1032/2049] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/projects => generated 401 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:24.784455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.868453 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1018/2050] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:24.869620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.907069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6fe40-8d97-40cb-8d74-5e8703c91ab7 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.910754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de52e-0fc3-4a4c-b017-727dd41a12ed admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.917186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.917817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.918119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.918367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.919041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.919794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6a891-3cd0-4017-ae2c-872e6e4e2270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.920567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6a891-3cd0-4017-ae2c-872e6e4e2270 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.921020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6a891-3cd0-4017-ae2c-872e6e4e2270 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.921131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.921541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6a891-3cd0-4017-ae2c-872e6e4e2270 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.922333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6a891-3cd0-4017-ae2c-872e6e4e2270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:24.924203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6a891-3cd0-4017-ae2c-872e6e4e2270 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:24.930535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:24.947753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1033/2051] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:24.949211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982b1a-370f-48d7-bbdf-224f313e8dc9 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.949497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982b1a-370f-48d7-bbdf-224f313e8dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.949770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982b1a-370f-48d7-bbdf-224f313e8dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.958889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1019/2052] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/users => generated 301 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:24.958889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:24.973541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48ba69-2d72-4550-b08d-1a0671e21ed0 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:24.977903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8e982b1a-370f-48d7-bbdf-224f313e8dc9 None None] MFA Rules not processed for user `8113c4a291ba490bb6d321abf9931926`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:24.979209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:24.979368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8e982b1a-370f-48d7-bbdf-224f313e8dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:24.980679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:24.980679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:24.980984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] PATH_INFO: `/v3/projects/0c1b045c452d41c694515381af50e349/users/b8e677b9e06e4263acd3b21c83ad14fd/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:24.997645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1b045c452d41c694515381af50e349, user_id=b8e677b9e06e4263acd3b21c83ad14fd, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.000308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.017050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1020/2053] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:24 2022] PUT /identity/v3/projects/0c1b045c452d41c694515381af50e349/users/b8e677b9e06e4263acd3b21c83ad14fd/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:25.018023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.061334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1034/2054] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:25.062863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.063210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.063540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.103381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4b5c-7988-4865-a6cd-c2bc8c3567a2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.106786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] MFA Rules not processed for user `b8e677b9e06e4263acd3b21c83ad14fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:25.108227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.108549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.109222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.109502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.109774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.110423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.112132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.125316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1021/2055] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:25.126176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.127905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.152681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:25.205566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1035/2056] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:25.209090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.212005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.245026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f01d-045b-4bf0-b7d0-5227eb1a9163 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.247999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad987f-a07a-4b1f-95bc-154741eaa8f4 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.255771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.256700 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.257151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.257662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.258270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.259518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.259919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.260297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] PATH_INFO: `/v3/users/dbac30a86a6446fc872e0170637cabf5` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.260990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.262385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbac30a86a6446fc872e0170637cabf5)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.264746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.331886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbac30a86a6446fc872e0170637cabf5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:25.333079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbac30a86a6446fc872e0170637cabf5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:25.340965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbac30a86a6446fc872e0170637cabf5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:25.341155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.341894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbac30a86a6446fc872e0170637cabf5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:25.342789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.347893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:25.351958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbac30a86a6446fc872e0170637cabf5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:25.358525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1022/2057] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:25.359385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.371563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36095c57-ee75-45e9-a0ae-f6ac2ddfce20 service nova] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.378238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.379326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.380250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.380250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.380823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.382603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.398758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1023/2058] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:25.399797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.401695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.413336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1036/2059] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:25 2022] DELETE /identity/v3/users/dbac30a86a6446fc872e0170637cabf5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:25.414503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.416642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.516439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d495f-ca2a-48e8-ab9c-93551857c371 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.564888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e30f-6d44-423c-82d0-1ab605b3ef14 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.575456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0202e-4e0a-4694-a2a4-30ccab01aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.576142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0202e-4e0a-4694-a2a4-30ccab01aafc admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.576424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0202e-4e0a-4694-a2a4-30ccab01aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.576700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0202e-4e0a-4694-a2a4-30ccab01aafc admin admin] PATH_INFO: `/v3/projects/719ef77ad0e443b59968a3e32a718b3d/users/bf68728d27e14952bfc8459c6ef2b18f/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.601344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0202e-4e0a-4694-a2a4-30ccab01aafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=719ef77ad0e443b59968a3e32a718b3d, user_id=bf68728d27e14952bfc8459c6ef2b18f, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.604616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0202e-4e0a-4694-a2a4-30ccab01aafc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.619720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.620458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.620871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.621244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.625499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.629950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1037/2060] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:25 2022] PUT /identity/v3/projects/719ef77ad0e443b59968a3e32a718b3d/users/bf68728d27e14952bfc8459c6ef2b18f/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:25.631613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16acd-6a83-4435-a464-d92d0fa363cb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.631970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16acd-6a83-4435-a464-d92d0fa363cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.632360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16acd-6a83-4435-a464-d92d0fa363cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.661690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1ec16acd-6a83-4435-a464-d92d0fa363cb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:25.663202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1ec16acd-6a83-4435-a464-d92d0fa363cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.699030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:25.748354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1038/2061] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:25.749741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.751501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:25.755071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.755550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.755898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.775750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1024/2062] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:25.799890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] MFA Rules not processed for user `bf68728d27e14952bfc8459c6ef2b18f`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:25.801673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.866397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.867718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:25.919404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1039/2063] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:25.924881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:25.945289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57ed66-ec93-4b64-b9e0-c82b6e03220d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.960650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:25.976110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194d39-ba8c-438d-a2b8-5c04cba28d78 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:25.986134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:25.986354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:25.986606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:25.987278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:25.991974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:25.993811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.074937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1040/2064] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:25 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:26.078876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:26.126550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.127490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.127893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.130083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.166862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.168650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.195465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1025/2065] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:26.229842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f569b6-10d0-4d95-8a3b-ff272a5aca47 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:26.237027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.248749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.249400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.249973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.251105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.258777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.289444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1041/2066] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:26 2022] POST /identity/v3/users => generated 306 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:26.293168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:26.307628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37375a9-c16a-444d-aba6-13369a543fbd service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:26.338448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.338708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.338890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.339186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.343159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.343380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.358810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1026/2067] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:26.362737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:26.390864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877f4e2-c4f7-4290-9176-aa80339a72b6 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:26.434466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.435153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.435432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.435711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] PATH_INFO: `/v3/projects/7be6b63977b44f83a3b3419a7c1647c9/users/817cdaa9de344d878e51f49c71126e64/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.462300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be6b63977b44f83a3b3419a7c1647c9, user_id=817cdaa9de344d878e51f49c71126e64, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.467442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.492166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1042/2068] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:26 2022] PUT /identity/v3/projects/7be6b63977b44f83a3b3419a7c1647c9/users/817cdaa9de344d878e51f49c71126e64/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:26.495902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:26.512689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62c9f9-0c96-4a4c-ae85-f8af24eb566c admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:26.583590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98b80a-f535-41e5-bf4a-561cbdea1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.584237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b80a-f535-41e5-bf4a-561cbdea1a50 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.584546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b80a-f535-41e5-bf4a-561cbdea1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.584860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b80a-f535-41e5-bf4a-561cbdea1a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.585517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98b80a-f535-41e5-bf4a-561cbdea1a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.587168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98b80a-f535-41e5-bf4a-561cbdea1a50 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.600138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1027/2069] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:26.604988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:26.610732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:26.621670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417a12d-2867-4e84-ba5b-64d8d3994630 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:26.627470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.628613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.629029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.629678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] PATH_INFO: `/v3/projects/7be6b63977b44f83a3b3419a7c1647c9/users/817cdaa9de344d878e51f49c71126e64/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.632401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be6b63977b44f83a3b3419a7c1647c9, user_id=817cdaa9de344d878e51f49c71126e64, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.635231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:26.650484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1043/2070] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:26 2022] PUT /identity/v3/projects/7be6b63977b44f83a3b3419a7c1647c9/users/817cdaa9de344d878e51f49c71126e64/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:26.664592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.664926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.665264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.705305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] MFA Rules not processed for user `817cdaa9de344d878e51f49c71126e64`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:26.707807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:26.814196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1028/2071] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:26.832746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:26.970736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edffd-e8fa-413c-a466-8ef6e9573552 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:26.975817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:26.976441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:26.976746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:26.977039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:26.992148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:26.993790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:27.011968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1044/2072] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:27.134406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:27.136886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:27.145405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:27.179054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89851-def3-4142-a6ba-ff945b8873f4 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:27.202960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5342101-ef5a-4fa8-8dab-9635260a213c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:27.203971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342101-ef5a-4fa8-8dab-9635260a213c service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:27.204398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342101-ef5a-4fa8-8dab-9635260a213c service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:27.204648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:27.205134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342101-ef5a-4fa8-8dab-9635260a213c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:27.297012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1634ab-8f3f-4ba3-91c3-aef2c4f91225 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:27.309021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:27.313287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:27.313572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:27.313850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] PATH_INFO: `/v3/projects/2561132ca22e4641a1e03efdc4922120` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:27.316551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2561132ca22e4641a1e03efdc4922120)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:27.319890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:27.324117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5342101-ef5a-4fa8-8dab-9635260a213c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:27.346615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5342101-ef5a-4fa8-8dab-9635260a213c service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:27.366916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1045/2073] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:27 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:27.423970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2561132ca22e4641a1e03efdc4922120', 'request_id': 'req-e570c620-22fd-4db9-ba9b-e88c03a648e4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:27.445682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2561132ca22e4641a1e03efdc4922120', 'request_id': 'req-e570c620-22fd-4db9-ba9b-e88c03a648e4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:27.461156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2561132ca22e4641a1e03efdc4922120', 'request_id': 'req-e570c620-22fd-4db9-ba9b-e88c03a648e4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:27.500458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] The token cache is being invalidate because project 2561132ca22e4641a1e03efdc4922120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:27.501580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:27.502579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-e570c620-22fd-4db9-ba9b-e88c03a648e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:27.505980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1029/2074] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:27 2022] DELETE /identity/v3/projects/2561132ca22e4641a1e03efdc4922120 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:27.511813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:27.512793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:27.513272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:27.540016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:27.541323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:27.638862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1046/2075] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:27.647592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:27.648307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:27.648751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:27.681341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:27.683368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:27.720796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1030/2076] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:27.725200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:27.740315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24d38-36b1-4a28-8e6a-b12b9788b13c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:27.754952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:27.755789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:27.756475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:27.756866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:27.758132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:27.758495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:27.762072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:27.798268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1047/2077] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:27.806154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:27.823107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea52fca-b727-4f7f-af0a-699ee0f0167a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:27.834979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:27.837083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:27.837083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:27.837257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:27.840594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:27.843382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:27.938038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1031/2078] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:27 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:27.943633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:27.958135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58538087-8a28-462d-88b9-a49ae9982db9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.000234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:28.091244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.091988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.092683 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.093088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.093804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.096848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.143967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1048/2079] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:27 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:28.147417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.165329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef38e9-28e9-420d-8a30-67096bb9e5a2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.175217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.176982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.178631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.179198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.181008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.185417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.217206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1032/2080] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:28.218487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.229717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872ea7-df9f-48a0-ad4f-ea9bf3b0028e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.246161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0e83-e54c-4f5a-9ca2-b4192863804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.247200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0e83-e54c-4f5a-9ca2-b4192863804a admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.247671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0e83-e54c-4f5a-9ca2-b4192863804a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.248136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0e83-e54c-4f5a-9ca2-b4192863804a admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.250271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0e83-e54c-4f5a-9ca2-b4192863804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.256816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0e83-e54c-4f5a-9ca2-b4192863804a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.298161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1049/2081] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:28.302196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.316139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c312e1-d1bc-4024-b6c5-ea442b7e984b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.323235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.325115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.325945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.325945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] PATH_INFO: `/v3/projects/60879e6a39b44d979c16c5d95c046ea2/users/c61659aba0944521a13803c988dec2a0/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.357743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60879e6a39b44d979c16c5d95c046ea2, user_id=c61659aba0944521a13803c988dec2a0, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.360939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.384007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1033/2082] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:28 2022] PUT /identity/v3/projects/60879e6a39b44d979c16c5d95c046ea2/users/c61659aba0944521a13803c988dec2a0/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:28.395676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbf90e-eafa-49e2-8068-0e1a4988e123 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.395988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbf90e-eafa-49e2-8068-0e1a4988e123 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.396253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbf90e-eafa-49e2-8068-0e1a4988e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.429828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-33cbf90e-eafa-49e2-8068-0e1a4988e123 None None] MFA Rules not processed for user `c61659aba0944521a13803c988dec2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:28.431029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-33cbf90e-eafa-49e2-8068-0e1a4988e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.500238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1050/2083] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:28.505126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.561420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:28.568787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2ca7-74dc-481b-93fa-5ced7be36c3d None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.570044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2ca7-74dc-481b-93fa-5ced7be36c3d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.571410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2ca7-74dc-481b-93fa-5ced7be36c3d None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.574679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1051/2084] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:48:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:48:28.575417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50528b20-160b-4bb2-b02d-cd954d92ec76 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.583390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.584173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.584957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.585439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.585706 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.586181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.586685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.587398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.589433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.612244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:28.613868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.630161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1034/2085] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:28 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:28.631829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.696074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1052/2086] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:28.697006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.699073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.714228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e391285-4c8a-4d22-bbee-f9a690faf1c3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.737138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:28.738604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb8cb-f64f-499b-9794-f0a49667d332 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.743794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.744877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.745203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.745479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.747124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.749475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.775477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1035/2087] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:28 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:28.776240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.778347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.790573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.791366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.791782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.792150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] PATH_INFO: `/v3/users/2dfb260d28124123a245c857da7e0279` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.793718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfb260d28124123a245c857da7e0279)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.795788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.863185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfb260d28124123a245c857da7e0279'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:28.864625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfb260d28124123a245c857da7e0279'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:28.880244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6552309-9a72-4857-8b07-3792cf93ae49 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:28.882838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfb260d28124123a245c857da7e0279'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:28.883742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfb260d28124123a245c857da7e0279'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:28.886631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:28.887929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:28.888192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:28.888445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:28.891182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.893492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfb260d28124123a245c857da7e0279'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:28.911343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:28.913114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:28.918796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1053/2088] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:28 2022] DELETE /identity/v3/users/2dfb260d28124123a245c857da7e0279 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:28.922114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.922114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.944529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1036/2089] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:28.945561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:28.950052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:28.970129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e93245-00c2-4f43-a273-b6641328714b service placement] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.050474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:29.073730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abf95-6f07-48b3-b0ba-640dfa230b73 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.074314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.074981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.075264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.075692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] PATH_INFO: `/v3/users/b8e677b9e06e4263acd3b21c83ad14fd` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.076922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e677b9e06e4263acd3b21c83ad14fd)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.079472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.101082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.101720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.101999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.102306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.103300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.105598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.124356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1054/2090] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:29.132036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:29.150205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a644935-e11e-43fe-a2f6-7dc64fb921cf admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.156986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.157395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e677b9e06e4263acd3b21c83ad14fd'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.157857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.158400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.158678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e677b9e06e4263acd3b21c83ad14fd'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.159028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] PATH_INFO: `/v3/projects/e216b64380754dfdbc65bcdd17d87e27/users/fc507353edaa4a7fa111a363c4645beb/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.168811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e677b9e06e4263acd3b21c83ad14fd'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.180913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e677b9e06e4263acd3b21c83ad14fd'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.181828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-462b0b65-b271-4aff-8b30-4f50dd4a1f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e677b9e06e4263acd3b21c83ad14fd'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.181947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216b64380754dfdbc65bcdd17d87e27, user_id=fc507353edaa4a7fa111a363c4645beb, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.185023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.210669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1055/2091] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:29 2022] PUT /identity/v3/projects/e216b64380754dfdbc65bcdd17d87e27/users/fc507353edaa4a7fa111a363c4645beb/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:29.212118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:29.213573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1037/2092] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:28 2022] DELETE /identity/v3/users/b8e677b9e06e4263acd3b21c83ad14fd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:29.214369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.218236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.218596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.218942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.242713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:29.244059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.244678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:29.342462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf784b-d5c6-40b3-b449-df912aa2065f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.395106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1038/2093] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:29.405235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:29.408551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.458083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.458999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.459429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.459851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.460818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.462687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.489762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1056/2094] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:29.494285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:29.507698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178cb75-ac5d-4263-b7dc-b3cb64c3ae03 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.512784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.513460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.513739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.514118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] PATH_INFO: `/v3/projects/e216b64380754dfdbc65bcdd17d87e27/users/fc507353edaa4a7fa111a363c4645beb/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.520836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216b64380754dfdbc65bcdd17d87e27, user_id=fc507353edaa4a7fa111a363c4645beb, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.523540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.534472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48f200-c8ec-44bd-87cc-1681e4d62454 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.546436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1057/2095] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:29 2022] PUT /identity/v3/projects/e216b64380754dfdbc65bcdd17d87e27/users/fc507353edaa4a7fa111a363c4645beb/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:29.547728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:29.557749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.599194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:29.633443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab3260-bdd4-4e9b-b8c3-581e6c068d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.634070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab3260-bdd4-4e9b-b8c3-581e6c068d65 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.634353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab3260-bdd4-4e9b-b8c3-581e6c068d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.634682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab3260-bdd4-4e9b-b8c3-581e6c068d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.646680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab3260-bdd4-4e9b-b8c3-581e6c068d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.648541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab3260-bdd4-4e9b-b8c3-581e6c068d65 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.650339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8ac0-ce51-42a3-921d-16b42d4c09ba admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.656002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:29.657248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.657586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.657938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] PATH_INFO: `/v3/projects/9cb2556ba8d8495d9fefef939185bdb8` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.659211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb2556ba8d8495d9fefef939185bdb8)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:29.661478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:29.666229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1039/2096] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:29.667745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.668089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.668456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.712908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] MFA Rules not processed for user `fc507353edaa4a7fa111a363c4645beb`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:29.714516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.741749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:29.748337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb2556ba8d8495d9fefef939185bdb8', 'request_id': 'req-d7d2882d-0856-4294-a682-31841aed2a57'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.765579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb2556ba8d8495d9fefef939185bdb8', 'request_id': 'req-d7d2882d-0856-4294-a682-31841aed2a57'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.777418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb2556ba8d8495d9fefef939185bdb8', 'request_id': 'req-d7d2882d-0856-4294-a682-31841aed2a57'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.803229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] The token cache is being invalidate because project 9cb2556ba8d8495d9fefef939185bdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:29.803803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.806185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d7d2882d-0856-4294-a682-31841aed2a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:29.811806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1058/2097] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:29 2022] DELETE /identity/v3/projects/9cb2556ba8d8495d9fefef939185bdb8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:29.814396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750817-5302-4361-9581-3ccdf26ba22b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.815027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750817-5302-4361-9581-3ccdf26ba22b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.815027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5750817-5302-4361-9581-3ccdf26ba22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.845781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e5750817-5302-4361-9581-3ccdf26ba22b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:29.846356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1040/2098] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:29.851170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e5750817-5302-4361-9581-3ccdf26ba22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.871351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:29.873123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:29.948629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1059/2099] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:29.956253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03452-489a-4394-9652-1001932c909f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:29.958149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bf8ac-9876-4f7d-9ac2-7bebf0f61b92 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:29.958646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03452-489a-4394-9652-1001932c909f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:29.959101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03452-489a-4394-9652-1001932c909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:29.986807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1cf03452-489a-4394-9652-1001932c909f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:29.988710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1cf03452-489a-4394-9652-1001932c909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.003372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1060/2100] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:30.005882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03452-489a-4394-9652-1001932c909f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.031502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03452-489a-4394-9652-1001932c909f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.031789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.032650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.033166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.033811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.037109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.037906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.038528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.038817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.039089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.039981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:30.040610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.045700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.077280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1061/2101] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:30.078477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.083214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.087034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:30.097068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85bbae-68c3-4668-ba69-800752a9998f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.111630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.112653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.112653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.112905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] PATH_INFO: `/v3/projects/0c1b045c452d41c694515381af50e349` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.114150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1b045c452d41c694515381af50e349)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.122584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.150444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.152560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.169588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1041/2102] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:30.170253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.183567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1b045c452d41c694515381af50e349', 'request_id': 'req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:30.184987 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc539d8-be79-4f49-b961-2e08dcaa8171 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.198278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1b045c452d41c694515381af50e349', 'request_id': 'req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:30.209715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1b045c452d41c694515381af50e349', 'request_id': 'req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:30.234771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] The token cache is being invalidate because project 0c1b045c452d41c694515381af50e349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:30.235060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:30.239878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fce5fcdf-d263-4d2c-8eb3-01c660d0d657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:30.242021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1062/2103] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:30 2022] DELETE /identity/v3/projects/0c1b045c452d41c694515381af50e349 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:30.247245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650ee8-ebfa-43df-94b3-72f56a9de893 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.248318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650ee8-ebfa-43df-94b3-72f56a9de893 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.248595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650ee8-ebfa-43df-94b3-72f56a9de893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.280936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.282197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.283171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.283452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.284141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.288066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.290647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e4650ee8-ebfa-43df-94b3-72f56a9de893 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:30.291859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e4650ee8-ebfa-43df-94b3-72f56a9de893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.307637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1063/2104] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:30.318242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.318701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.319063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.376744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1042/2105] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:30.377124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:30.377124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.390004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.392000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.434265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:30.497066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889a464-6bba-4703-85a4-5859d86f7a90 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.502796 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.504257 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.504984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.505365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1064/2106] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:30.505561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.506354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.508692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.509585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.527227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82274611-ca7a-42d1-a87f-23490daadbc0 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.536322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.536991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.537262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.537539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.538262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:30.538498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.540275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.542905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1043/2107] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:30.546415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.559494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc5b2-ff7b-47e5-a017-b9aa05f5bfa4 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.565542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.566735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.567020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.567373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.568263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.570103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.571759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1065/2108] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:30.576004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.589436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1044/2109] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:30.590631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.594219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01867204-8843-4e97-9a48-678cfbcd0d63 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.603995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84719f-0662-4354-b9a4-811ec15c1d26 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.612213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.613727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.613918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.614399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.615318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.615504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.616125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.616410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.616687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.617370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.617567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.619316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.631816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1045/2110] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:30.635519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.655686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8146-b905-40b6-b21f-c34d73828ffd admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.664929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffde4f-91a4-40a1-b170-1ccee75b44e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.665799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffde4f-91a4-40a1-b170-1ccee75b44e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.666225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffde4f-91a4-40a1-b170-1ccee75b44e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.666404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffde4f-91a4-40a1-b170-1ccee75b44e4 admin admin] PATH_INFO: `/v3/projects/3c4e5ef86b874d8abdc5cb6fde17d421/users/0d79b76436a8435ea4718ef91c21c712/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.684259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1066/2111] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:30.688006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.691363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffde4f-91a4-40a1-b170-1ccee75b44e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4e5ef86b874d8abdc5cb6fde17d421, user_id=0d79b76436a8435ea4718ef91c21c712, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.694743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffde4f-91a4-40a1-b170-1ccee75b44e4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.712092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:30.721385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1046/2112] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:30 2022] PUT /identity/v3/projects/3c4e5ef86b874d8abdc5cb6fde17d421/users/0d79b76436a8435ea4718ef91c21c712/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:30.727419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.728081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.728360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.756973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:30.756973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.780881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55916-dfcf-4b69-b177-9ae396d85096 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.869687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.870425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.870711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.870988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.872468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.877752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.888812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1047/2113] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:30.900087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.901919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:30.927293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1067/2114] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:30 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:30.928542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.945514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad881a-d706-434f-ab96-afb53c4f9f6d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.957646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:30.958274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:30.958760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:30.959050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:30.959925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:30.961949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:30.980809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1068/2115] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:30.981880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:30.993894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e649fd5-6414-45f3-a013-ce51b4f2318f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:30.999260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:31.000336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:31.000336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:31.000610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:31.001435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:31.004364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:31.018360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57c491-cf84-49c6-b690-0d30b9831059 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:31.023942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1069/2116] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:31.024954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:31.028658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a17581-795a-4c4c-b406-de58f7a23609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:31.029315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a17581-795a-4c4c-b406-de58f7a23609 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:31.029597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a17581-795a-4c4c-b406-de58f7a23609 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:31.029871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a17581-795a-4c4c-b406-de58f7a23609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:31.035669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02b00f-fe20-42dc-a8ff-b96f5fea3ced admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:31.040393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a17581-795a-4c4c-b406-de58f7a23609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:31.041918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a17581-795a-4c4c-b406-de58f7a23609 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:31.042042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:31.042865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:31.043301 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:31.043600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] PATH_INFO: `/v3/projects/8d88635b969c4206a092f1be47f5b3d8/users/c424cbd571834d55845ecd264fe5ee4a/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:31.052840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:31.054852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1048/2117] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:31.063136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d88635b969c4206a092f1be47f5b3d8, user_id=c424cbd571834d55845ecd264fe5ee4a, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:31.066978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:31.083804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1070/2118] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:31 2022] PUT /identity/v3/projects/8d88635b969c4206a092f1be47f5b3d8/users/c424cbd571834d55845ecd264fe5ee4a/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:31.098581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:31.099028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:31.099325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:31.134144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] MFA Rules not processed for user `c424cbd571834d55845ecd264fe5ee4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:31.135818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:31.213421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1049/2119] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:31.227739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:31.230123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:31.295657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207356f-bd51-4bd5-9a70-2a4073002224 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:31.299395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddda19c-1b86-4471-92a7-f3bc11e0d248 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:31.300054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddda19c-1b86-4471-92a7-f3bc11e0d248 service glance] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:31.300291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddda19c-1b86-4471-92a7-f3bc11e0d248 service glance] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:31.300581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddda19c-1b86-4471-92a7-f3bc11e0d248 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:31.309833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddda19c-1b86-4471-92a7-f3bc11e0d248 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:31.311289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddda19c-1b86-4471-92a7-f3bc11e0d248 service glance] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:31.322213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1071/2120] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:32.324740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:32.326400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:32.395862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:32.452607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678ed4b-b681-46a1-9fd0-b595bf8e52c1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:32.458787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:32.459445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:32.460748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:32.461046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] PATH_INFO: `/v3/users/bf68728d27e14952bfc8459c6ef2b18f` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:32.462250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf68728d27e14952bfc8459c6ef2b18f)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:32.464274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:32.562311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf68728d27e14952bfc8459c6ef2b18f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:32.562995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf68728d27e14952bfc8459c6ef2b18f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:32.572569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf68728d27e14952bfc8459c6ef2b18f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:32.584379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf68728d27e14952bfc8459c6ef2b18f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:32.585473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf68728d27e14952bfc8459c6ef2b18f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:32.626207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1050/2121] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:32 2022] DELETE /identity/v3/users/bf68728d27e14952bfc8459c6ef2b18f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:32.631415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:32.631907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:32.631907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:32.680451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:32.681913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:32.850040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1072/2122] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:32.860494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:32.862047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:32.957902 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7252-790e-458d-a7d5-815b1814ae23 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:32.962756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6683d-f85c-428e-bb46-1fb6b27fb043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:32.963383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6683d-f85c-428e-bb46-1fb6b27fb043 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:32.963673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6683d-f85c-428e-bb46-1fb6b27fb043 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:32.963932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6683d-f85c-428e-bb46-1fb6b27fb043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:32.979585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6683d-f85c-428e-bb46-1fb6b27fb043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:32.981385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6683d-f85c-428e-bb46-1fb6b27fb043 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:33.004946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1051/2123] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:33.091498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:33.095629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:33.121110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513c9d-057b-4c73-ad38-18776d77e296 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:33.132065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:33.133082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:33.133487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:33.133786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] PATH_INFO: `/v3/users/c61659aba0944521a13803c988dec2a0` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:33.135198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61659aba0944521a13803c988dec2a0)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:33.137991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:33.214713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61659aba0944521a13803c988dec2a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.218535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61659aba0944521a13803c988dec2a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.230877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61659aba0944521a13803c988dec2a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.230877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61659aba0944521a13803c988dec2a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.250418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61659aba0944521a13803c988dec2a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.290824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1073/2124] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:33 2022] DELETE /identity/v3/users/c61659aba0944521a13803c988dec2a0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:33.294393 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:33.295025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:33.295572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:33.317897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:33.320070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:33.380287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:33.401538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1052/2125] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:33.415471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:33.417556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:33.443321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:33.490185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:33.492854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:33.518280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c3bb0-0013-4cea-8f46-f8819d1d76cc None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:33.523701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:33.524844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:33.525131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:33.525409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] PATH_INFO: `/v3/projects/719ef77ad0e443b59968a3e32a718b3d` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:33.526799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=719ef77ad0e443b59968a3e32a718b3d)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:33.528815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:33.582669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c87d24-a134-4f6e-b543-70513a6e384b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:33.590257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:33.590924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:33.591311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:33.591759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:33.604699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:33.606395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:33.624559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719ef77ad0e443b59968a3e32a718b3d', 'request_id': 'req-5ce72b33-a65c-4936-9bf8-a819526fe28d'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.630177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1074/2126] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:33.635143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719ef77ad0e443b59968a3e32a718b3d', 'request_id': 'req-5ce72b33-a65c-4936-9bf8-a819526fe28d'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.647635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719ef77ad0e443b59968a3e32a718b3d', 'request_id': 'req-5ce72b33-a65c-4936-9bf8-a819526fe28d'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.694940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] The token cache is being invalidate because project 719ef77ad0e443b59968a3e32a718b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:33.695241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.696068 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.697803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1053/2127] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:33 2022] DELETE /identity/v3/projects/719ef77ad0e443b59968a3e32a718b3d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:33.701932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:33.721030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57db6a-456b-4bbb-9c30-e637f15262c2 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:33.830588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:33.832508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:33.833067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:33.833706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] PATH_INFO: `/v3/users/817cdaa9de344d878e51f49c71126e64` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:33.835555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817cdaa9de344d878e51f49c71126e64)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:33.839085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:33.925546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817cdaa9de344d878e51f49c71126e64'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.927465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817cdaa9de344d878e51f49c71126e64'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.938603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817cdaa9de344d878e51f49c71126e64'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.939741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817cdaa9de344d878e51f49c71126e64'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:33.955980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817cdaa9de344d878e51f49c71126e64'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.002159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1075/2128] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:33 2022] DELETE /identity/v3/users/817cdaa9de344d878e51f49c71126e64 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:34.136599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:34.138091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:34.162647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce72b33-a65c-4936-9bf8-a819526fe28d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:34.307069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:34.307069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:34.307386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:34.307651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] PATH_INFO: `/v3/projects/60879e6a39b44d979c16c5d95c046ea2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:34.308873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60879e6a39b44d979c16c5d95c046ea2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:34.311079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:34.429878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60879e6a39b44d979c16c5d95c046ea2', 'request_id': 'req-5085ac80-8c06-4e14-a3ce-685968cf540b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.442246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60879e6a39b44d979c16c5d95c046ea2', 'request_id': 'req-5085ac80-8c06-4e14-a3ce-685968cf540b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.459995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60879e6a39b44d979c16c5d95c046ea2', 'request_id': 'req-5085ac80-8c06-4e14-a3ce-685968cf540b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.476498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] The token cache is being invalidate because project 60879e6a39b44d979c16c5d95c046ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:34.476839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.477727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.479702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1054/2129] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:34 2022] DELETE /identity/v3/projects/60879e6a39b44d979c16c5d95c046ea2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:34.483782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:34.485954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:34.500698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c003ab-a9c3-4019-89db-6c52aeeea2b7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:34.527034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:34.575700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:34.576459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:34.577032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:34.577383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] PATH_INFO: `/v3/users/fc507353edaa4a7fa111a363c4645beb` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:34.578684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc507353edaa4a7fa111a363c4645beb)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:34.580803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:34.622633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:34.629228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:34.657622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085ac80-8c06-4e14-a3ce-685968cf540b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:34.659780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc507353edaa4a7fa111a363c4645beb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.660658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc507353edaa4a7fa111a363c4645beb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.664666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:34.665602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:34.666311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:34.666740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] PATH_INFO: `/v3/projects/7be6b63977b44f83a3b3419a7c1647c9` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:34.669281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be6b63977b44f83a3b3419a7c1647c9)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:34.670249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc507353edaa4a7fa111a363c4645beb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.671108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc507353edaa4a7fa111a363c4645beb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.672022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:34.675485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:34.684483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0908a62b-308f-47cf-b920-5b9c97227add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc507353edaa4a7fa111a363c4645beb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.724212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1076/2130] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:34 2022] DELETE /identity/v3/users/fc507353edaa4a7fa111a363c4645beb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:34.759689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be6b63977b44f83a3b3419a7c1647c9', 'request_id': 'req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.772151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be6b63977b44f83a3b3419a7c1647c9', 'request_id': 'req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.787035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be6b63977b44f83a3b3419a7c1647c9', 'request_id': 'req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.813943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] The token cache is being invalidate because project 7be6b63977b44f83a3b3419a7c1647c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:34.814325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.815313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b6a59787-b4c3-41b7-932c-6de5b1efbdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:34.821422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1055/2131] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:34 2022] DELETE /identity/v3/projects/7be6b63977b44f83a3b3419a7c1647c9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:34.823769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604617ea-1d17-4101-a337-22397885e72c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:34.824593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604617ea-1d17-4101-a337-22397885e72c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:34.825068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604617ea-1d17-4101-a337-22397885e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:34.865404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-604617ea-1d17-4101-a337-22397885e72c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:34.867528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-604617ea-1d17-4101-a337-22397885e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:34.979586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1077/2132] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:34.981235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:34.981521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:34.981799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.015993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:35.017895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:35.047762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1056/2133] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:35.054348 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604617ea-1d17-4101-a337-22397885e72c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.072692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604617ea-1d17-4101-a337-22397885e72c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.083113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.083830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.084020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.084311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.085004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:35.085307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.087040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.126554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1078/2134] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:35.127793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.139932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf59beb-cfdd-4168-8c99-b2c81ad8ead0 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.151734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.152372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.152657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.152992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.153659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.155825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.213864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1057/2135] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:35 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:35.223250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.256958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361574-3cfb-4c4a-8255-3f0ddf1f4b12 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.312565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:35.365862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.367476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.367866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.369696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.370998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.373587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.414616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1079/2136] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:35 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:35.418554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.433512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb652d57-5432-41fa-95f7-dfcaf429c116 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.440747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.442037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.442479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.443005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.444176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.446328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.468101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1058/2137] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:35.477300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.528979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04aed-b922-4461-99d3-309dec44c652 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.538543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.539382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.539670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.539948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.540606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.542894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.555992 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1080/2138] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:35.561391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.574811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.579951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:35.580233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1df1a-7fc7-414f-9f44-10c35e945dbd admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.586418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7749f8-b23a-45cc-b538-988287176347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.587730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7749f8-b23a-45cc-b538-988287176347 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.587730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7749f8-b23a-45cc-b538-988287176347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.588162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7749f8-b23a-45cc-b538-988287176347 admin admin] PATH_INFO: `/v3/projects/f40711d966de46afa3fb6b2ca61ae470/users/199151a08ced4183bc13f189cb6b87f8/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.604982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd0838-1e47-41c5-a992-bef6f33e96dc admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:35.622151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:35.623025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.623457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.623883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] PATH_INFO: `/v3/projects/e216b64380754dfdbc65bcdd17d87e27` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.625572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e216b64380754dfdbc65bcdd17d87e27)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.628542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.631767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7749f8-b23a-45cc-b538-988287176347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40711d966de46afa3fb6b2ca61ae470, user_id=199151a08ced4183bc13f189cb6b87f8, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:35.637437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7749f8-b23a-45cc-b538-988287176347 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:35.676124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1059/2139] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:35 2022] PUT /identity/v3/projects/f40711d966de46afa3fb6b2ca61ae470/users/199151a08ced4183bc13f189cb6b87f8/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:35.678929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.678929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.679219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.717160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] MFA Rules not processed for user `199151a08ced4183bc13f189cb6b87f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:35.718762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:35.728318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e216b64380754dfdbc65bcdd17d87e27', 'request_id': 'req-d27761c4-3d95-43b2-86ee-c1294e73e6d2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:35.736390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e216b64380754dfdbc65bcdd17d87e27', 'request_id': 'req-d27761c4-3d95-43b2-86ee-c1294e73e6d2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:35.755638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e216b64380754dfdbc65bcdd17d87e27', 'request_id': 'req-d27761c4-3d95-43b2-86ee-c1294e73e6d2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:35.778924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] The token cache is being invalidate because project e216b64380754dfdbc65bcdd17d87e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:35.779331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:35.780187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d27761c4-3d95-43b2-86ee-c1294e73e6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:35.781778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1081/2140] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:35 2022] DELETE /identity/v3/projects/e216b64380754dfdbc65bcdd17d87e27 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:35.788332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace3c22-1072-4772-9b6d-93315ce05274 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.788647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace3c22-1072-4772-9b6d-93315ce05274 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.788919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace3c22-1072-4772-9b6d-93315ce05274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:35.828930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cace3c22-1072-4772-9b6d-93315ce05274 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:35.830679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cace3c22-1072-4772-9b6d-93315ce05274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:35.901074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1060/2141] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:35.902282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:35.903890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:35.931919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:35.971008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1082/2142] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:35.980539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:35.980941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:35.982014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.024141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:36.025614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:36.052852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1083/2143] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:36.057766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.063103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bf71c-045e-4496-9d1d-36b52bbab196 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.068352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14183203-71e7-4c18-bd35-6768d5ef08e7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.070292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.071017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.071789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.072066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.072741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.074846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.077571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.078903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.079488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.080024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.082147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:36.082635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.085560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.112297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1084/2144] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:36.120747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.137511 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1061/2145] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:35 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:36.141591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.143124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a74a6-aa18-40e7-b989-c2cd52cbbfaa admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.157222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:36.239575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.240521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.240977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.241493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.242608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.243342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a2d56-e691-4940-869d-6dd5eabc9142 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.246614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.249447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.250261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.250890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.251340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.252166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.255247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.305698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1085/2146] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:36 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:36.311058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.327924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1062/2147] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:36 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:36.332708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.346472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff6d9-f41a-4c17-bd8f-a347c2c4362b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.404680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a274e3-83a1-4633-8e41-e00f6ac197b0 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.410443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.411113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.411401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.411674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.412361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.414626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.437570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.438291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.438711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.439204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.440352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1086/2148] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:36 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:36.443400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.444273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.445409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.457526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b346c-ede4-4182-8cad-9e1eae00e6d7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.462140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1063/2149] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:36.467441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.481375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.482063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.482345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.482919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.483529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807a76-3333-40c3-8626-054db8c0d810 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.483657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.485876 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.489447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.490298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.490691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.491076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] PATH_INFO: `/v3/projects/87c0ede923544dddb368d31e8a24e0cd/users/aa56491ca83c44c5bb380bc7a0d784b2/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.502304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1087/2150] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:36.507612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.509019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c0ede923544dddb368d31e8a24e0cd, user_id=aa56491ca83c44c5bb380bc7a0d784b2, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.513073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.522550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0f8ae-177e-4f5d-a707-d320058b3244 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.533806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1064/2151] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:36 2022] PUT /identity/v3/projects/87c0ede923544dddb368d31e8a24e0cd/users/aa56491ca83c44c5bb380bc7a0d784b2/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:36.538202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.547484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:36.625129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e353-f6f7-4533-96a6-268f0d5e2577 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.632759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.633472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.633756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.634548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.635212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.636927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.651999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1065/2152] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:36.656822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.667909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.669917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faed78-a1d7-4689-8794-4f3b4b382f6b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.671509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.671802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.672079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.672874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.674425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.692586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1088/2153] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:36.693695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:36.694612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808554a-bfdd-470c-abe2-7ced1640e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.695638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808554a-bfdd-470c-abe2-7ced1640e449 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.696236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808554a-bfdd-470c-abe2-7ced1640e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.696866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808554a-bfdd-470c-abe2-7ced1640e449 admin admin] PATH_INFO: `/v3/projects/87c0ede923544dddb368d31e8a24e0cd/users/aa56491ca83c44c5bb380bc7a0d784b2/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.700932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808554a-bfdd-470c-abe2-7ced1640e449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c0ede923544dddb368d31e8a24e0cd, user_id=aa56491ca83c44c5bb380bc7a0d784b2, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.704515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808554a-bfdd-470c-abe2-7ced1640e449 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.708452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b8d27-2c11-41ba-a1b3-e9a227cccd43 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:36.715224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667d07-31d6-4ace-bc23-257fcdc255af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:36.715997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667d07-31d6-4ace-bc23-257fcdc255af admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.716469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667d07-31d6-4ace-bc23-257fcdc255af admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.718990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667d07-31d6-4ace-bc23-257fcdc255af admin admin] PATH_INFO: `/v3/projects/f0ba1c29bba84fdeb9c2431658e4d7c9/users/8e9bc26c865047408e2e5d0deb19b5a0/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.721462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1066/2154] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:36 2022] PUT /identity/v3/projects/87c0ede923544dddb368d31e8a24e0cd/users/aa56491ca83c44c5bb380bc7a0d784b2/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:36.733767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.734057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.734341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.752989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:36.762147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667d07-31d6-4ace-bc23-257fcdc255af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ba1c29bba84fdeb9c2431658e4d7c9, user_id=8e9bc26c865047408e2e5d0deb19b5a0, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:36.765074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667d07-31d6-4ace-bc23-257fcdc255af admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:36.793844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] MFA Rules not processed for user `aa56491ca83c44c5bb380bc7a0d784b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:36.803231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:36.804001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1089/2155] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:36 2022] PUT /identity/v3/projects/f0ba1c29bba84fdeb9c2431658e4d7c9/users/8e9bc26c865047408e2e5d0deb19b5a0/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:36.814650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:36.814869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:36.815722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:36.875302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] MFA Rules not processed for user `8e9bc26c865047408e2e5d0deb19b5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:36.876848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:36.994286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1067/2156] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:37.026758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.028426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:37.057801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1090/2157] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:37.061645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.147458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2c906-f4bf-4599-9ccc-fa8c4b647231 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.152282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efb317-d8af-47b8-94b5-c5dd5e2294fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.153153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb317-d8af-47b8-94b5-c5dd5e2294fb service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.153809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb317-d8af-47b8-94b5-c5dd5e2294fb service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.154258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efb317-d8af-47b8-94b5-c5dd5e2294fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.168271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb317-d8af-47b8-94b5-c5dd5e2294fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.170306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efb317-d8af-47b8-94b5-c5dd5e2294fb service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.187755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1068/2158] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:37.193191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5269f2-8138-4919-a368-a6a9e93bc6fd None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.201444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.202667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.203132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.203559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.204896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.208188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.241088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.242036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.242652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.255122 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1091/2159] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:37 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:37.259194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.287216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] MFA Rules not processed for user `0d79b76436a8435ea4718ef91c21c712`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:37.287216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:37.291199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:37.349993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f3c8-a65f-4860-9a60-e145656734d3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.367528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.369623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.370624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.372367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.373147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.381396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.395619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:37.433444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1069/2160] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:37.445059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1092/2161] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:37 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:37.462932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.463421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.471121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:37.487932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a685-ab30-4e4b-8c6d-3a2c46851d03 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.507008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.508570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.508897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.509175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.509949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.512112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.537307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1070/2162] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:37.546378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.577159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d9416-b749-4ff3-b4af-8ad06d8e0389 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.584672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.585541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.585925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.586303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.587060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.588849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.597344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23b22-0da3-4393-baab-db7f752fe446 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.605267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960ebad-345c-4257-91bb-a63540ffe55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.606152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ebad-345c-4257-91bb-a63540ffe55b service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.607979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ebad-345c-4257-91bb-a63540ffe55b service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.607979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ebad-345c-4257-91bb-a63540ffe55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.618597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1071/2163] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:37.621024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ebad-345c-4257-91bb-a63540ffe55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.622797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960ebad-345c-4257-91bb-a63540ffe55b service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.623981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.636461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed64738-c2c9-441c-939c-d6e6efdcecb4 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.639386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1093/2164] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:37.644744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.645797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.646318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.647446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] PATH_INFO: `/v3/projects/1fb86fdf9abb43148c8fbec00966fdbb/users/6c60418927334e39813cceed1585ade8/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.671473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb86fdf9abb43148c8fbec00966fdbb, user_id=6c60418927334e39813cceed1585ade8, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.674462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.695577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1072/2165] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:37 2022] PUT /identity/v3/projects/1fb86fdf9abb43148c8fbec00966fdbb/users/6c60418927334e39813cceed1585ade8/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:37.708191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.708191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.708191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.764640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] MFA Rules not processed for user `6c60418927334e39813cceed1585ade8`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:37.766066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:37.850651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.895811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1094/2166] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:37.900487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:37.944270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6d8d-366a-42b4-93cc-76252f29e088 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:37.952762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:37.953566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:37.953935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:37.954407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] PATH_INFO: `/v3/users/199151a08ced4183bc13f189cb6b87f8` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:37.957289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199151a08ced4183bc13f189cb6b87f8)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:37.961100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:37.994980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1cec9-f660-4880-b610-78d6b18e4dcb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.003330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.004381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.004665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.005164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.006351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.009123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.032839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:38.051660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199151a08ced4183bc13f189cb6b87f8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:38.053293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199151a08ced4183bc13f189cb6b87f8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:38.059104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1095/2167] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:37 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:38.062952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.063739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199151a08ced4183bc13f189cb6b87f8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:38.071542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:38.078935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199151a08ced4183bc13f189cb6b87f8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:38.079830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-722dc441-2f74-4773-a037-49af47331c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199151a08ced4183bc13f189cb6b87f8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:38.111942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1073/2168] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:37 2022] DELETE /identity/v3/users/199151a08ced4183bc13f189cb6b87f8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:38.123898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.124096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.124283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.159159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:38.162859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:38.220819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de49eaa-6d15-46d7-ab0a-1b52d5edda76 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.255841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1074/2169] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:38.293083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.295191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:38.380439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.381889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.386623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.389852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.390682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.393077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.424484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f5ef-1e9f-48bc-a0da-4d2eb91b2ed0 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.429308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.430195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.430484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.430759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.440944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1096/2170] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:38 2022] POST /identity/v3/users => generated 299 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:38.444691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.445054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.447300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:38.449841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.483605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1075/2171] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:38.507042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffe900-de39-42d3-a670-ad7971541aa4 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.514404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.515672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.516148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.516509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.519305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.523687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.540840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1097/2172] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:38.547670 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.572464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a2d2e-b3ab-48eb-aec2-356d05a7ba4f service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.579243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.580383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.580926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.581972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] PATH_INFO: `/v3/projects/3c792d1922d249969bf15af9381aec0f/users/238d98fdffaa4e279953027f348d84dc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.607280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c792d1922d249969bf15af9381aec0f, user_id=238d98fdffaa4e279953027f348d84dc, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.610766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.627169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1076/2173] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:38 2022] PUT /identity/v3/projects/3c792d1922d249969bf15af9381aec0f/users/238d98fdffaa4e279953027f348d84dc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:38.634313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.654296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3df6-7ef8-426c-ba5d-7404dabe426b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.750197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a76f0-b761-40c6-9abc-10ca643a1e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.750824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a76f0-b761-40c6-9abc-10ca643a1e93 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.751106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a76f0-b761-40c6-9abc-10ca643a1e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.751378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a76f0-b761-40c6-9abc-10ca643a1e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.752037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a76f0-b761-40c6-9abc-10ca643a1e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.755452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a76f0-b761-40c6-9abc-10ca643a1e93 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.772594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1098/2174] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:38.774629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.795013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f084-eb08-413c-9e1e-0d486a83def6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:38.802510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:38.803191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.803528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.803814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] PATH_INFO: `/v3/projects/3c792d1922d249969bf15af9381aec0f/users/238d98fdffaa4e279953027f348d84dc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.806170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c792d1922d249969bf15af9381aec0f, user_id=238d98fdffaa4e279953027f348d84dc, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:38.809361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:38.826386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1077/2175] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:38 2022] PUT /identity/v3/projects/3c792d1922d249969bf15af9381aec0f/users/238d98fdffaa4e279953027f348d84dc/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:38.838797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:38.838797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:38.838797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:38.875611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] MFA Rules not processed for user `238d98fdffaa4e279953027f348d84dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:38.877176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:38.883278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:38.960000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:38.963736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:39.026053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1099/2176] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:39.039050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:39.040536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:39.074051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:39.139578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02accb8d-1770-4570-af42-6d282a3d0e34 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:39.145653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:39.146506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:39.146634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206835f5-b0bf-4ad8-afef-968eb56595a7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:39.146783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:39.147057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] PATH_INFO: `/v3/projects/f40711d966de46afa3fb6b2ca61ae470` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:39.148313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40711d966de46afa3fb6b2ca61ae470)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:39.152725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:39.153487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:39.154004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:39.154136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:39.154451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:39.156566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:39.256824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40711d966de46afa3fb6b2ca61ae470', 'request_id': 'req-d231fd55-29fc-472b-8e12-4369435cd964'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.259277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:39.261423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:39.267695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40711d966de46afa3fb6b2ca61ae470', 'request_id': 'req-d231fd55-29fc-472b-8e12-4369435cd964'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.282216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40711d966de46afa3fb6b2ca61ae470', 'request_id': 'req-d231fd55-29fc-472b-8e12-4369435cd964'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.294063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1100/2177] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:39.318100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] The token cache is being invalidate because project f40711d966de46afa3fb6b2ca61ae470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:39.318693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.319636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d231fd55-29fc-472b-8e12-4369435cd964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.325254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1078/2178] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:38 2022] DELETE /identity/v3/projects/f40711d966de46afa3fb6b2ca61ae470 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:39.326098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:39.345296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f82a-a25a-4088-a7bf-5d6d1586d6f5 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:39.439154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:39.457457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:39.458120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:39.458470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:39.458699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] PATH_INFO: `/v3/users/aa56491ca83c44c5bb380bc7a0d784b2` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:39.461891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa56491ca83c44c5bb380bc7a0d784b2)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:39.463751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:39.576137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa56491ca83c44c5bb380bc7a0d784b2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.576891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa56491ca83c44c5bb380bc7a0d784b2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.593623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa56491ca83c44c5bb380bc7a0d784b2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.595530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa56491ca83c44c5bb380bc7a0d784b2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.613126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa56491ca83c44c5bb380bc7a0d784b2'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:39.713084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1101/2179] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:39 2022] DELETE /identity/v3/users/aa56491ca83c44c5bb380bc7a0d784b2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:40.080108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73eeb-70d2-45d9-aef4-f55046541a71 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.080675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73eeb-70d2-45d9-aef4-f55046541a71 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.080675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73eeb-70d2-45d9-aef4-f55046541a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.116843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c0c73eeb-70d2-45d9-aef4-f55046541a71 None None] MFA Rules not processed for user `0d79b76436a8435ea4718ef91c21c712`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:40.118856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c0c73eeb-70d2-45d9-aef4-f55046541a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:40.244783 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1079/2180] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:40.266284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:40.268622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:40.355617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff5a0-ca23-46a8-89cc-acaaebdc2b35 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:40.363793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:40.364547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.364859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.365135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] PATH_INFO: `/v3/projects/87c0ede923544dddb368d31e8a24e0cd` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.366347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c0ede923544dddb368d31e8a24e0cd)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:40.368530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:40.430495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c0ede923544dddb368d31e8a24e0cd', 'request_id': 'req-57489d68-62d7-4073-bf6b-7231f713d2ee'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:40.437616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c0ede923544dddb368d31e8a24e0cd', 'request_id': 'req-57489d68-62d7-4073-bf6b-7231f713d2ee'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:40.446542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c0ede923544dddb368d31e8a24e0cd', 'request_id': 'req-57489d68-62d7-4073-bf6b-7231f713d2ee'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:40.458758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] The token cache is being invalidate because project 87c0ede923544dddb368d31e8a24e0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:40.459073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:40.459727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57489d68-62d7-4073-bf6b-7231f713d2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:40.461267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1102/2181] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:40 2022] DELETE /identity/v3/projects/87c0ede923544dddb368d31e8a24e0cd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:40.467994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.468292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.468573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.494442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:40.495666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:40.570561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1080/2182] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:40.579023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.579309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.579586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.588954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:40.603450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:40.605384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:40.613986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1103/2183] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:40.618593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:40.630747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b1e9a-87c5-4c70-a5d6-6612a4f1fe07 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:40.635890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:40.636650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.637142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.637387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.638109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:40.638490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:40.640398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:40.658826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1081/2184] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:40.659987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:40.670967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf1b7b-d3b7-4470-8699-7f153b641e35 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:40.677365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:40.677987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.678270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.678544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.679189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:40.681143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:40.717114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1104/2185] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:40 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:40.721497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:40.733449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57634a2f-a33c-4730-a3ed-a57ca7a239e5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:40.738361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:40.821730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:40.822341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.822628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.822903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.823561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:40.826181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:40.855702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1082/2186] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:40 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:40.860827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:40.874240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d8ac9-f7af-4c57-b38f-72944c1a3ea2 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:40.882667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:40.883092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.883533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.884000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.884855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:40.886621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:40.898524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1105/2187] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:40.905945 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:40.933539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73756133-6701-4e64-8a0c-f7d8481ce0e7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:40.940785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268885fb-98de-4e20-8f67-3524264e2e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:40.941629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268885fb-98de-4e20-8f67-3524264e2e0c admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:40.942546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268885fb-98de-4e20-8f67-3524264e2e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:40.942836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268885fb-98de-4e20-8f67-3524264e2e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:40.943788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268885fb-98de-4e20-8f67-3524264e2e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:40.946101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268885fb-98de-4e20-8f67-3524264e2e0c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:40.962036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1083/2188] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:40.967926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:41.005239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe74c6-7370-4baf-ba45-62279f1d77ed admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:41.014796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:41.016215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:41.017063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:41.017848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] PATH_INFO: `/v3/projects/bd513f9fa41f4afca85493896732d16c/users/e46c68f2a2504187b9d0d03a0236799a/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:41.088644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd513f9fa41f4afca85493896732d16c, user_id=e46c68f2a2504187b9d0d03a0236799a, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:41.091889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:41.124835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1106/2189] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:40 2022] PUT /identity/v3/projects/bd513f9fa41f4afca85493896732d16c/users/e46c68f2a2504187b9d0d03a0236799a/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:41.125890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:41.126292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:41.126443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:41.272278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:41.274035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:41.293974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:41.296906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:41.442332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1084/2190] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:48:41.452797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:41.454336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:41.456870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc400-8a32-4471-b169-4f87df52e398 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:41.462691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:41.463323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:41.463618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:41.463870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:41.470083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:41.600912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:41.602723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:41.610989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abcded-026d-4c65-83d6-09b2c33c316b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:41.616601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1107/2191] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:41.619739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:41.620535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:41.620861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:41.621143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:41.631579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:41.633206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:41.648305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1085/2192] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:48:42.069390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:42.071230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:42.087646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adc1dc-7999-4280-bac8-52836ea55919 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:42.091907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:42.092599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:42.092911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:42.093185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:42.097121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:42.234717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:42.263426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:42.269053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:42.296045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1108/2193] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:42.563869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:42.579113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5cc4e-4fa7-4f19-a8a2-10f57a45c1da service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:42.588748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:42.589637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:42.589745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:42.590115 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:42.593398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:42.650219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:42.732550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:42.734421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1c650-ffbc-4f8c-8657-5532eb12dedb service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:42.748846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1086/2194] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:47.306325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:47.308488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:47.342691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aefcf-b441-49ef-b982-2a23184721d6 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:47.357721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:47.358569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:47.358960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:47.359331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] PATH_INFO: `/v3/users/8e9bc26c865047408e2e5d0deb19b5a0` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:47.362740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9bc26c865047408e2e5d0deb19b5a0)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:47.365440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:47.455096 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9bc26c865047408e2e5d0deb19b5a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:47.456906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9bc26c865047408e2e5d0deb19b5a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:47.467015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9bc26c865047408e2e5d0deb19b5a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:47.467935 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9bc26c865047408e2e5d0deb19b5a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:47.478987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9bc26c865047408e2e5d0deb19b5a0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:47.512057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1109/2195] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:47 2022] DELETE /identity/v3/users/8e9bc26c865047408e2e5d0deb19b5a0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:47.516409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:47.516969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:47.516969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:47.571747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:47.573029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:47.775315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1087/2196] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:47.804322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:47.806942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:47.900449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8db07-fd57-4d99-956b-b26085c71cf8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:47.904767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:47.905401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:47.905689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:47.905961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:47.919660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:47.921853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:47.935686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1110/2197] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:48.757550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:48.759020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:48.795978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645a1e-8c76-4ff4-8445-8735b641d125 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:48.805416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:48.806258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:48.806684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:48.807693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] PATH_INFO: `/v3/projects/f0ba1c29bba84fdeb9c2431658e4d7c9` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:48.809152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ba1c29bba84fdeb9c2431658e4d7c9)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:48.811916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:48.903278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ba1c29bba84fdeb9c2431658e4d7c9', 'request_id': 'req-1c6825b9-066b-4831-8595-07fbccd1cc65'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:48.934170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ba1c29bba84fdeb9c2431658e4d7c9', 'request_id': 'req-1c6825b9-066b-4831-8595-07fbccd1cc65'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:48.942445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ba1c29bba84fdeb9c2431658e4d7c9', 'request_id': 'req-1c6825b9-066b-4831-8595-07fbccd1cc65'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:48.961641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] The token cache is being invalidate because project f0ba1c29bba84fdeb9c2431658e4d7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:48.962350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:48.963619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1c6825b9-066b-4831-8595-07fbccd1cc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:48.966534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1088/2198] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:48 2022] DELETE /identity/v3/projects/f0ba1c29bba84fdeb9c2431658e4d7c9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:48.972247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:48.986023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060257e-3066-4b43-9909-d7de17897d9e service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:49.155511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:49.156282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:49.156667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:49.157083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] PATH_INFO: `/v3/users/6c60418927334e39813cceed1585ade8` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:49.158550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c60418927334e39813cceed1585ade8)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:49.162326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:49.168326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:49.254229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c60418927334e39813cceed1585ade8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:49.255753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c60418927334e39813cceed1585ade8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:49.268017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c60418927334e39813cceed1585ade8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:49.269071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c60418927334e39813cceed1585ade8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:49.279468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c60418927334e39813cceed1585ade8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:49.335479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1111/2199] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:48 2022] DELETE /identity/v3/users/6c60418927334e39813cceed1585ade8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:49.945184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:49.945711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:49.946003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:49.987751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] MFA Rules not processed for user `e46c68f2a2504187b9d0d03a0236799a`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:49.989174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:50.020546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.022091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:50.050804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:50.099566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1089/2200] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:50.104163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.105981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:50.115089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddc180-2131-4c3b-9e5a-cc0a92ecf524 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.122697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.123269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.123573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.123857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] PATH_INFO: `/v3/projects/1fb86fdf9abb43148c8fbec00966fdbb` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.125053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb86fdf9abb43148c8fbec00966fdbb)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.127926 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.128185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6de4-368b-4cea-85ff-c79c94afd91f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.137664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.138287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.138629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.138891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.139533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.141491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.176318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1090/2201] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:50 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:50.180579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.186877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb86fdf9abb43148c8fbec00966fdbb', 'request_id': 'req-5158189e-8c6f-4408-9533-dfc566643fd1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.194142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb86fdf9abb43148c8fbec00966fdbb', 'request_id': 'req-5158189e-8c6f-4408-9533-dfc566643fd1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.203502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb86fdf9abb43148c8fbec00966fdbb', 'request_id': 'req-5158189e-8c6f-4408-9533-dfc566643fd1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.218113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] The token cache is being invalidate because project 1fb86fdf9abb43148c8fbec00966fdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:50.220180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.220931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.223430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1112/2202] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:50 2022] DELETE /identity/v3/projects/1fb86fdf9abb43148c8fbec00966fdbb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:50.227241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.228620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:50.244880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:50.291087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a43ea-13a1-483a-938f-e2bbba20653d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.296348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.297072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.297354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.297623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.298263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.300351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.317871 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158189e-8c6f-4408-9533-dfc566643fd1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.325954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.326658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.327032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.327355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] PATH_INFO: `/v3/users/238d98fdffaa4e279953027f348d84dc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.329102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238d98fdffaa4e279953027f348d84dc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.329304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1091/2203] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:50 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:50.332464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.333868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.336368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:50.351534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8593-e2d8-41d9-8425-d8bf3aa43ebb admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.358474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.359294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.359746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.360015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.360620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.362716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.381291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1092/2204] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:50.382296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.390273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238d98fdffaa4e279953027f348d84dc'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.391065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238d98fdffaa4e279953027f348d84dc'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.392764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12b4f-7a56-4df9-9cc9-448803301f4a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.398283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.398948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.399230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.399499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] PATH_INFO: `/v3/projects/574f603153f44dc4839551d59497f550/users/ca381d84429345cead106563c94788b5/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.400366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238d98fdffaa4e279953027f348d84dc'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.401069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238d98fdffaa4e279953027f348d84dc'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.411522 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238d98fdffaa4e279953027f348d84dc'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:50.421591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=574f603153f44dc4839551d59497f550, user_id=ca381d84429345cead106563c94788b5, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.424804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.436474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1113/2205] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:50 2022] DELETE /identity/v3/users/238d98fdffaa4e279953027f348d84dc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:50.444442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1093/2206] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:50 2022] PUT /identity/v3/projects/574f603153f44dc4839551d59497f550/users/ca381d84429345cead106563c94788b5/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:50.448691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.457248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:50.574093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d0b8f-724f-4584-941e-3a71bc48d9c2 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.680377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:50.723732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.725848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.728812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.729140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.730093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.733828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.760752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1114/2207] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:50.762807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:50.777771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccd0d2-a15b-47d8-a320-c9e31c651cba admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:50.798179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3312-153a-451d-97e6-923bdc4ba6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:50.800473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3312-153a-451d-97e6-923bdc4ba6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:50.801054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3312-153a-451d-97e6-923bdc4ba6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:50.801533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3312-153a-451d-97e6-923bdc4ba6e7 admin admin] PATH_INFO: `/v3/projects/574f603153f44dc4839551d59497f550/users/ca381d84429345cead106563c94788b5/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:50.808477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3312-153a-451d-97e6-923bdc4ba6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574f603153f44dc4839551d59497f550, user_id=ca381d84429345cead106563c94788b5, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:50.815421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3312-153a-451d-97e6-923bdc4ba6e7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:50.843617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1094/2208] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:50 2022] PUT /identity/v3/projects/574f603153f44dc4839551d59497f550/users/ca381d84429345cead106563c94788b5/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:51.102911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:51.109996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:51.130899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296bbc3-4ca4-464e-b3aa-0923ecacb7a8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:51.312614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:51.315172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:51.315716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:51.316149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] PATH_INFO: `/v3/projects/3c792d1922d249969bf15af9381aec0f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:51.317628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c792d1922d249969bf15af9381aec0f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:51.322074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:51.414370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c792d1922d249969bf15af9381aec0f', 'request_id': 'req-0cca729a-bc70-43af-902d-10461d372d37'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:51.422390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c792d1922d249969bf15af9381aec0f', 'request_id': 'req-0cca729a-bc70-43af-902d-10461d372d37'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:51.438038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c792d1922d249969bf15af9381aec0f', 'request_id': 'req-0cca729a-bc70-43af-902d-10461d372d37'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:51.485731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] The token cache is being invalidate because project 3c792d1922d249969bf15af9381aec0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:51.489211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:51.491362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0cca729a-bc70-43af-902d-10461d372d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:51.499272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1115/2209] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:51 2022] DELETE /identity/v3/projects/3c792d1922d249969bf15af9381aec0f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:51.501157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:51.501644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:51.503074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:51.590095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:51.592994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:51.753141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:51.787733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1095/2210] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:51.795973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:51.796281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:51.796567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:51.817369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:51.818601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:51.828684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1116/2211] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:51.834356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:51.845705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbcc7d-2a2f-4280-b82c-2bc9e58b1b5a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:51.853355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:51.853524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:51.853810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:51.854003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:51.854625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:51.854929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:51.856563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:51.873313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1096/2212] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:51.874492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:51.886067 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493f26b-7f82-45b6-a059-95f82c7fecf3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:51.890957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:51.891502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:51.892179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:51.892179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:51.892689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:51.896015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:51.929841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1117/2213] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:51 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:51.934024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:51.945649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f5ef-c6c8-423b-872e-ff79760d6def admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:52.067041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:52.067744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.068037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.068985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.070114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:52.074432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:52.142357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1097/2214] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:51 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:48:52.147252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:52.166618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c6583-8796-4aa7-b639-ad618dfb62d6 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:52.180788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:52.181172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.181455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.181761 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.183960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:52.191375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:52.216066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1118/2215] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:52.220430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:52.233613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22084303-673c-4237-b07f-876d7dfaa5c7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:52.240236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822528ed-1c62-40ad-816a-cf69e5de0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:52.240929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822528ed-1c62-40ad-816a-cf69e5de0061 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.241219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822528ed-1c62-40ad-816a-cf69e5de0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.241663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822528ed-1c62-40ad-816a-cf69e5de0061 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.242603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822528ed-1c62-40ad-816a-cf69e5de0061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:52.244470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822528ed-1c62-40ad-816a-cf69e5de0061 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:52.258931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1098/2216] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:52.262963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:52.279470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa5df8-e963-425b-8ce7-124a68f2c684 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:52.287261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:52.288234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.288529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.288854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] PATH_INFO: `/v3/projects/8f881706301f4104b1cf204b316e0337/users/fe8c570430a34919ad682819dc8abe58/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.317642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f881706301f4104b1cf204b316e0337, user_id=fe8c570430a34919ad682819dc8abe58, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:52.321182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:52.347741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1119/2217] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:52 2022] PUT /identity/v3/projects/8f881706301f4104b1cf204b316e0337/users/fe8c570430a34919ad682819dc8abe58/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:48:52.360608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.360951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.361345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.408953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] MFA Rules not processed for user `fe8c570430a34919ad682819dc8abe58`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:52.410245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:52.561559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1099/2218] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:52.586759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:52.593402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:52.597945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:52.725306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d398664-2f29-46a3-8bf7-9db521955a8a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:52.745288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a050e8-1a69-4369-a6f3-5929cf2c3128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:52.746052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a050e8-1a69-4369-a6f3-5929cf2c3128 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:52.746337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a050e8-1a69-4369-a6f3-5929cf2c3128 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:52.746614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a050e8-1a69-4369-a6f3-5929cf2c3128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:52.791028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a050e8-1a69-4369-a6f3-5929cf2c3128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:52.792814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a050e8-1a69-4369-a6f3-5929cf2c3128 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:52.819411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1120/2219] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:52.859356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:52.956840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:53.050171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b437604-d8f4-4c3f-bd76-513ac3d05e9c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:53.070287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:53.071379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:53.072099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:53.072841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] PATH_INFO: `/v3/users/fe8c570430a34919ad682819dc8abe58` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:53.074637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8c570430a34919ad682819dc8abe58)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:53.077220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:53.177939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8c570430a34919ad682819dc8abe58'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:53.180454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8c570430a34919ad682819dc8abe58'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:53.200091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8c570430a34919ad682819dc8abe58'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:53.212217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8c570430a34919ad682819dc8abe58'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:53.212871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8c570430a34919ad682819dc8abe58'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:53.250484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1100/2220] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:52 2022] DELETE /identity/v3/users/fe8c570430a34919ad682819dc8abe58 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:53.255331 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:53.255918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:53.256094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:53.308072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:53.309594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:53.430879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1121/2221] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:53.468546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:53.470651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:53.590216 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af4d66-1555-4512-be98-fbd8aea1f0a9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:53.594195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebe4d7-0015-46a5-b921-d965fb47adc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:53.595617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebe4d7-0015-46a5-b921-d965fb47adc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:53.595617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebe4d7-0015-46a5-b921-d965fb47adc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:53.595811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebe4d7-0015-46a5-b921-d965fb47adc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:53.616108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebe4d7-0015-46a5-b921-d965fb47adc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:53.617808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebe4d7-0015-46a5-b921-d965fb47adc6 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:53.638049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1101/2222] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:54.317369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:54.319620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:54.347515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6172a9-fd7d-4662-a515-01048ea75f99 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:54.358819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:54.359782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:54.360279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:54.360773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] PATH_INFO: `/v3/projects/8f881706301f4104b1cf204b316e0337` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:54.364570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f881706301f4104b1cf204b316e0337)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:54.383158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:54.486318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f881706301f4104b1cf204b316e0337', 'request_id': 'req-21b1db83-6993-44d3-b2c4-a84b842eaace'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:54.495018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f881706301f4104b1cf204b316e0337', 'request_id': 'req-21b1db83-6993-44d3-b2c4-a84b842eaace'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:54.505677 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f881706301f4104b1cf204b316e0337', 'request_id': 'req-21b1db83-6993-44d3-b2c4-a84b842eaace'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:54.522832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] The token cache is being invalidate because project 8f881706301f4104b1cf204b316e0337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:54.523230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:54.524206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-21b1db83-6993-44d3-b2c4-a84b842eaace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:54.529525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1122/2223] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:54 2022] DELETE /identity/v3/projects/8f881706301f4104b1cf204b316e0337 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:54.531272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:54.532413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:54.532413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:54.554386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:54.555622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:54.647016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1102/2224] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:54.656340 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:54.657083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:54.657570 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:54.682850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:54.684156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:54.700852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1123/2225] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:54.705997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:54.717829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846535b-a6c8-4f42-8fef-e6f19ae377ef None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:54.724707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:54.725443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:54.726126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:54.726585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:54.727804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:48:54.728231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:54.730244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:54.741684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:54.747690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1103/2226] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:48:54.751156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:54.762328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064d4f5-1450-49d2-bf88-a6e1f6191c74 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:54.768879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:54.769319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:54.769750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:54.770023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:54.770736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:54.773164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:54.802972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:54.811141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1124/2227] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:48:54 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:54.816496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:54.836554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3a0f0-6ce5-45fe-baac-d380a778c6ee admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:54.959642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:54.960282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:54.960574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:54.963063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:54.963732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:54.965723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:55.021533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1104/2228] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:48:54 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:48:55.022261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:55.036273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7951-afc1-4f15-af5f-3c3fb954f2eb admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:55.041606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:55.042668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:55.043711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:55.044238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:55.045642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:55.047728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:55.078699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:55.091715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1125/2229] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:48:55.095275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d923b7-65fc-4f0d-9542-fe6be6b00171 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:55.117872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40515f5-7571-419d-b1f1-493be6099b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:55.124982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40515f5-7571-419d-b1f1-493be6099b68 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:55.125578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40515f5-7571-419d-b1f1-493be6099b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:55.125992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40515f5-7571-419d-b1f1-493be6099b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:55.127904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40515f5-7571-419d-b1f1-493be6099b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:55.132221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40515f5-7571-419d-b1f1-493be6099b68 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:55.180159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1105/2230] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:55.184142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:55.207292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9835fc-6ca1-4f5c-a9dd-e4b4eb849d46 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:55.220147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:55.220968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:55.221316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:55.221656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] PATH_INFO: `/v3/projects/18f51055736d4fe2b11e872c89821a05/users/a4fbf8526e714c8cb26c24c7ea8ff738/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:55.298885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f51055736d4fe2b11e872c89821a05, user_id=a4fbf8526e714c8cb26c24c7ea8ff738, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:55.305204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:55.361280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1126/2231] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:55 2022] PUT /identity/v3/projects/18f51055736d4fe2b11e872c89821a05/users/a4fbf8526e714c8cb26c24c7ea8ff738/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:55.372733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056823-8035-4fe1-bfa0-83917fe5241a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:55.373031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056823-8035-4fe1-bfa0-83917fe5241a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:55.373306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056823-8035-4fe1-bfa0-83917fe5241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:55.428301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-79056823-8035-4fe1-bfa0-83917fe5241a None None] MFA Rules not processed for user `a4fbf8526e714c8cb26c24c7ea8ff738`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:55.429651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-79056823-8035-4fe1-bfa0-83917fe5241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:55.626572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1106/2232] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:55.701580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:55.703757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:55.876647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb12be3-bc5c-4301-bb3a-6cd10de96f62 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:55.895488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fccecc-edc0-492c-a6c8-76e6a0a6d3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:55.896184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fccecc-edc0-492c-a6c8-76e6a0a6d3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:55.896628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fccecc-edc0-492c-a6c8-76e6a0a6d3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:55.897118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fccecc-edc0-492c-a6c8-76e6a0a6d3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:55.907941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fccecc-edc0-492c-a6c8-76e6a0a6d3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:55.910476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fccecc-edc0-492c-a6c8-76e6a0a6d3c6 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:55.921369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1127/2233] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:57.483941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12396b05-db38-4e57-b01a-a34591782606 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:57.485247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12396b05-db38-4e57-b01a-a34591782606 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:57.485671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12396b05-db38-4e57-b01a-a34591782606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:57.521044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-12396b05-db38-4e57-b01a-a34591782606 None None] MFA Rules not processed for user `a4fbf8526e714c8cb26c24c7ea8ff738`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:57.523083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-12396b05-db38-4e57-b01a-a34591782606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:57.541884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1107/2234] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:57.715653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:57.716165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:57.716245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:57.747536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] MFA Rules not processed for user `ca381d84429345cead106563c94788b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:57.749099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:57.834831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1128/2235] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:57.849337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12396b05-db38-4e57-b01a-a34591782606 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:57.850774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-12396b05-db38-4e57-b01a-a34591782606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:57.930906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:57.952357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12396b05-db38-4e57-b01a-a34591782606 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:57.960878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:57.962316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:57.962786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:57.963400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:57.966751 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:58.059777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:58.062426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e57c88-1fe5-4f1a-b06c-364cf6b5cc3e service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:58.072932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1108/2236] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:59.349377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:59.351698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:59.491672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:59.525474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a7ba0-2c27-4498-8636-edc82ee6a50e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:59.545558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:59.546487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:59.546918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:59.547495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] PATH_INFO: `/v3/users/c424cbd571834d55845ecd264fe5ee4a` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:59.549890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c424cbd571834d55845ecd264fe5ee4a)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:59.552558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:59.699756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c424cbd571834d55845ecd264fe5ee4a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:59.702173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c424cbd571834d55845ecd264fe5ee4a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:59.739028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c424cbd571834d55845ecd264fe5ee4a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:59.740192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c424cbd571834d55845ecd264fe5ee4a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:59.764015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c424cbd571834d55845ecd264fe5ee4a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:59.807722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1129/2237] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:59 2022] DELETE /identity/v3/users/c424cbd571834d55845ecd264fe5ee4a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:59.812082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f828-0f3e-40ed-9e15-74943c3e3f2e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:59.812626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f828-0f3e-40ed-9e15-74943c3e3f2e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:59.812626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f828-0f3e-40ed-9e15-74943c3e3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:59.845213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b458f828-0f3e-40ed-9e15-74943c3e3f2e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:59.846830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b458f828-0f3e-40ed-9e15-74943c3e3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:59.974116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1109/2238] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:00.001985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:00.005569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:00.148665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b78d9-7091-48ee-abf4-13ee4d14c86c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:00.156164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:00.160856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:00.161232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:00.162186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:00.174836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:00.176927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:00.200117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1130/2239] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:00.345073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8095b5-cb1b-46b6-99b7-8c02285dc767 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:00.345443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8095b5-cb1b-46b6-99b7-8c02285dc767 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:00.345842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8095b5-cb1b-46b6-99b7-8c02285dc767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:00.411820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-de8095b5-cb1b-46b6-99b7-8c02285dc767 None None] MFA Rules not processed for user `e46c68f2a2504187b9d0d03a0236799a`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:00.413186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-de8095b5-cb1b-46b6-99b7-8c02285dc767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:00.559534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1110/2240] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:01.230781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:01.241622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:01.282113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b57bd-5bf1-4b90-a3db-c4dc11276389 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:01.296988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:01.298125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:01.299139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:01.299703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] PATH_INFO: `/v3/projects/8d88635b969c4206a092f1be47f5b3d8` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:01.302845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d88635b969c4206a092f1be47f5b3d8)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:01.313270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:01.433615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d88635b969c4206a092f1be47f5b3d8', 'request_id': 'req-a049c845-dd86-4a04-9b07-db1193271a1c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:01.452958 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d88635b969c4206a092f1be47f5b3d8', 'request_id': 'req-a049c845-dd86-4a04-9b07-db1193271a1c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:01.473843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d88635b969c4206a092f1be47f5b3d8', 'request_id': 'req-a049c845-dd86-4a04-9b07-db1193271a1c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:01.487930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:01.505358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] The token cache is being invalidate because project 8d88635b969c4206a092f1be47f5b3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:01.505358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:01.506010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a049c845-dd86-4a04-9b07-db1193271a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:01.513638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1131/2241] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:01 2022] DELETE /identity/v3/projects/8d88635b969c4206a092f1be47f5b3d8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:01.517191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:01.518239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:01.518779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:01.559549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:01.566043 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:01.636919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:01.690133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1111/2242] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:01.698334 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:01.698904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:01.699325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:01.737562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:01.743190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:01.763741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1132/2243] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:01.769355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:01.788131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3028a3d-76ae-4759-9095-ffe5aa02977c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:01.794592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:01.795289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:01.795577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:01.795856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:01.797399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:49:01.797714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:01.799603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:01.820428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1112/2244] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:49:01.824960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:01.844611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba570994-643f-4a7e-b4af-3e4182a06688 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:01.852353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:01.853784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:01.854087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:01.854366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:01.855021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:01.857748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:01.909172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1133/2245] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:49:01 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:01.910343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:01.924855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ab1ce-6723-4e51-8766-cc097a784a44 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:02.085323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:02.086366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:02.086801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:02.087271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:02.089569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:02.091771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:02.169046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1113/2246] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:49:01 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:02.173521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:02.187154 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d4d27-34a2-4b4b-ad54-81cf50ff2fe4 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:02.199983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:02.200765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:02.201064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:02.202819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:02.203568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:02.208768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:02.231629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1134/2247] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:02.235808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:02.249535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e680b-f0e1-48a5-911f-b45f5059b5d6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:02.268704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d418c-e9b4-426f-bd32-cd419a683ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:02.269366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d418c-e9b4-426f-bd32-cd419a683ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:02.269651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d418c-e9b4-426f-bd32-cd419a683ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:02.269935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d418c-e9b4-426f-bd32-cd419a683ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:02.271874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d418c-e9b4-426f-bd32-cd419a683ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:02.272277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d418c-e9b4-426f-bd32-cd419a683ec0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:02.298343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1114/2248] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:49:02.300893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:02.311805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2c04e-65ec-41b4-bff4-e343bde05c09 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:02.322753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:02.323441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:02.323726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:02.324003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] PATH_INFO: `/v3/projects/87c8e1362e2647ab83c811abfa5db47f/users/631355cfafd04ecdae597ddf9b9f1ee4/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:02.350332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c8e1362e2647ab83c811abfa5db47f, user_id=631355cfafd04ecdae597ddf9b9f1ee4, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:02.354487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:02.374710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1135/2249] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:49:02 2022] PUT /identity/v3/projects/87c8e1362e2647ab83c811abfa5db47f/users/631355cfafd04ecdae597ddf9b9f1ee4/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:02.388325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a39a-a0cf-4af3-a78d-fcc86726479a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:02.389230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a39a-a0cf-4af3-a78d-fcc86726479a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:02.389230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34a39a-a0cf-4af3-a78d-fcc86726479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:02.427015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-ce34a39a-a0cf-4af3-a78d-fcc86726479a None None] MFA Rules not processed for user `631355cfafd04ecdae597ddf9b9f1ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:02.428604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ce34a39a-a0cf-4af3-a78d-fcc86726479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:02.524925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1115/2250] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:02.528626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:02.531874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:02.672011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe564-2fe0-4ca3-a024-7fa74b3de5a7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:02.680230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75870a28-0c96-49a1-9147-8acfd97521a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:02.681364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870a28-0c96-49a1-9147-8acfd97521a3 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:02.681808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870a28-0c96-49a1-9147-8acfd97521a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:02.682231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75870a28-0c96-49a1-9147-8acfd97521a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:02.696317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75870a28-0c96-49a1-9147-8acfd97521a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:02.715510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75870a28-0c96-49a1-9147-8acfd97521a3 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:02.732501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1136/2251] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:07.294205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74257-9a1d-41d2-8a1e-4beedf4b81e2 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:07.294708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74257-9a1d-41d2-8a1e-4beedf4b81e2 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:07.294799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74257-9a1d-41d2-8a1e-4beedf4b81e2 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:07.296203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1116/2252] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:49:07.307832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:07.308373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:07.308373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:07.332270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] MFA Rules not processed for user `c882c87fe9e04430a9c453c761e55927`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:07.333475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:07.493626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1137/2253] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:49:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:07.526972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74257-9a1d-41d2-8a1e-4beedf4b81e2 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:07.529265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f4b74257-9a1d-41d2-8a1e-4beedf4b81e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:07.556239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74257-9a1d-41d2-8a1e-4beedf4b81e2 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:07.565140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:07.566007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:07.566869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:07.567515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:07.579845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:07.584632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:07.600862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1117/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:08.065380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:08.066847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:08.112353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:08.151230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3691a3f-78d7-49e5-8f91-56044a7531cb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:08.156124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:08.156836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:08.157120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:08.157389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] PATH_INFO: `/v3/users/8113c4a291ba490bb6d321abf9931926` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:08.158709 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8113c4a291ba490bb6d321abf9931926)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:08.160686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:08.214215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8113c4a291ba490bb6d321abf9931926'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.214864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8113c4a291ba490bb6d321abf9931926'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.223151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8113c4a291ba490bb6d321abf9931926'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.223822 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8113c4a291ba490bb6d321abf9931926'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.232943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8113c4a291ba490bb6d321abf9931926'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.263276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1138/2255] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:08 2022] DELETE /identity/v3/users/8113c4a291ba490bb6d321abf9931926 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:08.475264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:08.489601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046ac0-b488-451e-a0fa-e07e7e27f71c service placement] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:08.520089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:08.561075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:08.561726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:08.562007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:08.562286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] PATH_INFO: `/v3/projects/67543d086f4747c9ae2496585876394d` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:08.563471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67543d086f4747c9ae2496585876394d)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:08.566752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:08.665873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67543d086f4747c9ae2496585876394d', 'request_id': 'req-59ef8f0b-2936-4195-a755-a80723422c68'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.678327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67543d086f4747c9ae2496585876394d', 'request_id': 'req-59ef8f0b-2936-4195-a755-a80723422c68'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.688191 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67543d086f4747c9ae2496585876394d', 'request_id': 'req-59ef8f0b-2936-4195-a755-a80723422c68'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.704318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] The token cache is being invalidate because project 67543d086f4747c9ae2496585876394d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:08.705993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.706416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.711224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1118/2256] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:08 2022] DELETE /identity/v3/projects/67543d086f4747c9ae2496585876394d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:49:08.712671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:08.714674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:08.733179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603835a-f5eb-4ed3-a04b-0124f4c8f494 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:08.835771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:08.836561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:08.837094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:08.837498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] PATH_INFO: `/v3/users/36a9639fcb424e7fb25630b646fb89c8` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:08.839961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a9639fcb424e7fb25630b646fb89c8)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:08.842324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:08.953211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a9639fcb424e7fb25630b646fb89c8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.954180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a9639fcb424e7fb25630b646fb89c8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.964994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:08.967690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a9639fcb424e7fb25630b646fb89c8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.968590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a9639fcb424e7fb25630b646fb89c8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:08.984304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-57f452f8-f7c5-4d97-8bda-4516fb214eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a9639fcb424e7fb25630b646fb89c8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:09.039719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1139/2257] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:08 2022] DELETE /identity/v3/users/36a9639fcb424e7fb25630b646fb89c8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:09.318746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:09.320371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:09.334417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef8f0b-2936-4195-a755-a80723422c68 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:09.435904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:09.436848 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.437134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.437440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] PATH_INFO: `/v3/projects/fdee197735434f5588c428879efd7884` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.438608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdee197735434f5588c428879efd7884)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:09.441497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:09.504147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdee197735434f5588c428879efd7884', 'request_id': 'req-d0d72a57-de84-4bc0-b0ad-50070e19b82c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:09.513139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdee197735434f5588c428879efd7884', 'request_id': 'req-d0d72a57-de84-4bc0-b0ad-50070e19b82c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:09.516036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:09.521908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdee197735434f5588c428879efd7884', 'request_id': 'req-d0d72a57-de84-4bc0-b0ad-50070e19b82c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:09.536516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] The token cache is being invalidate because project fdee197735434f5588c428879efd7884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:09.537165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:09.538020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0d72a57-de84-4bc0-b0ad-50070e19b82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:09.540231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1119/2258] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:09 2022] DELETE /identity/v3/projects/fdee197735434f5588c428879efd7884 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:09.544970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.545540 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.546127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.568104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:09.569415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:09.652164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1140/2259] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:09.657219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.657722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.658626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.681989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:09.684223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:09.694935 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1120/2260] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:09.699140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:09.711232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117579a6-840d-4e15-a039-ff8704ff0f08 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:09.716004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:09.716882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.717168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.717445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.718108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:49:09.718414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:09.720572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:09.735063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1141/2261] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:49:09.739040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:09.748998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662194eb-cac9-4b5e-97ea-f6a0d968d9ea None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:09.754146 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:09.754833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.755185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.755522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.756373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:09.758885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:09.802028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1121/2262] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:49:09 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:09.804763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:09.813820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c77b3-6998-4080-9dc8-b32a8fc9efe6 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:09.888220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:09.888878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.889161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.889527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.890158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:09.892389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:09.928990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1142/2263] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:49:09 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:09.930279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:09.944642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3d47-692a-4ed0-9c8d-2f6f27137798 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:09.953542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:09.954176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.954474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.954927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.956784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:09.960130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:09.974532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1122/2264] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:49:09.978237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:09.991214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c4a6a-7b67-4c18-a014-23d49cc10002 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:09.995792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c9c87-cc4d-44f2-b1ff-6174a74109a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:09.996762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9c87-cc4d-44f2-b1ff-6174a74109a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:09.996762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9c87-cc4d-44f2-b1ff-6174a74109a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:09.996965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c9c87-cc4d-44f2-b1ff-6174a74109a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:09.997628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9c87-cc4d-44f2-b1ff-6174a74109a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.000048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c9c87-cc4d-44f2-b1ff-6174a74109a3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.012662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1143/2265] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:10.017617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.029420 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cff72-f662-4fa0-9864-84adc141e32d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.035288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.035640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.035903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.036178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] PATH_INFO: `/v3/projects/8ee88831554141bfb8d7049000c09f2b/users/9ad975b560c443e888abc6656c0ec3aa/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.056261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee88831554141bfb8d7049000c09f2b, user_id=9ad975b560c443e888abc6656c0ec3aa, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.059845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.077479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1123/2266] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:49:10 2022] PUT /identity/v3/projects/8ee88831554141bfb8d7049000c09f2b/users/9ad975b560c443e888abc6656c0ec3aa/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:10.089883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a64fe-fb7e-41db-8ee6-ece8009a7955 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.090127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a64fe-fb7e-41db-8ee6-ece8009a7955 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.090403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a64fe-fb7e-41db-8ee6-ece8009a7955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.147576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-f41a64fe-fb7e-41db-8ee6-ece8009a7955 None None] MFA Rules not processed for user `9ad975b560c443e888abc6656c0ec3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:10.149278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f41a64fe-fb7e-41db-8ee6-ece8009a7955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:10.203120 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:10.263627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1144/2267] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:10.268374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.334430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.334721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.335003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.339997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ee91a-a3ea-4183-995d-8c4d51f1ae09 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.346124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.346874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.347227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.347568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.348319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.350837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.356936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] MFA Rules not processed for user `f6f4f7ec5b174efb88287c751bd69365`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:10.358481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:10.407241 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1124/2268] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:49:10 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:10.410014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.438702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1145/2269] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:10.503309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56aedf1-60fc-483a-b62f-1e4ac3d3846f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.510245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.510998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.511125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.511400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.512047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.514205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.533898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:10.543604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1125/2270] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:49:10 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:49:10.547994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.559776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a2997-89ea-4320-b119-cf75e47e6817 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.564862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.565542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.565815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.566083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.566728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.568330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.583860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1146/2271] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:10.584811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.615388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5e617-cf57-464b-93a2-643e785677ee admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.623952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.624962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.625442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.625876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] PATH_INFO: `/v3/projects/9031434605d14bd28157571af1d4f34c/users/92e22e1a08f74266bb44529b98414eb7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.670374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9031434605d14bd28157571af1d4f34c, user_id=92e22e1a08f74266bb44529b98414eb7, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.684182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.703341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1126/2272] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:49:10 2022] PUT /identity/v3/projects/9031434605d14bd28157571af1d4f34c/users/92e22e1a08f74266bb44529b98414eb7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:49:10.707358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.718634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805eb9-c0e8-4a01-9ce1-2ec18c48462d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.799276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceaa35e-ba33-4739-a89d-8e5d0cd0f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.799448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaa35e-ba33-4739-a89d-8e5d0cd0f62e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.799672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaa35e-ba33-4739-a89d-8e5d0cd0f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.799947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaa35e-ba33-4739-a89d-8e5d0cd0f62e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.800630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceaa35e-ba33-4739-a89d-8e5d0cd0f62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.802357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceaa35e-ba33-4739-a89d-8e5d0cd0f62e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.819439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1147/2273] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:10.824465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:10.842907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f019c8-c51e-4d83-8aec-78cca5856925 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:10.859438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:10.860149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.860433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.860753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] PATH_INFO: `/v3/projects/9031434605d14bd28157571af1d4f34c/users/92e22e1a08f74266bb44529b98414eb7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.862759 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9031434605d14bd28157571af1d4f34c, user_id=92e22e1a08f74266bb44529b98414eb7, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:10.865881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:10.877352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1127/2274] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:49:10 2022] PUT /identity/v3/projects/9031434605d14bd28157571af1d4f34c/users/92e22e1a08f74266bb44529b98414eb7/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:49:10.888789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46a23-ebbf-48f4-bca2-4360d01a31cb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:10.889153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46a23-ebbf-48f4-bca2-4360d01a31cb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:10.889492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46a23-ebbf-48f4-bca2-4360d01a31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:10.924748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-85c46a23-ebbf-48f4-bca2-4360d01a31cb None None] MFA Rules not processed for user `92e22e1a08f74266bb44529b98414eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:10.926074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-85c46a23-ebbf-48f4-bca2-4360d01a31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:10.985614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:11.019997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1148/2275] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:11.035323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:11.037350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:11.144850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30622d5-5feb-4e08-828e-c463c7a9c6eb admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:11.155784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:11.156577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:11.157004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:11.157392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:11.263119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:11.264587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:11.277135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1128/2276] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:49:15.507840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:15.508345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:15.508442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:15.528782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:15.529939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:15.603408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1149/2277] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:49:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:15.650831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:15.652827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:15.727184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a516d-bf99-4c5e-b3d8-ef210b3480f5 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:15.733112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328430-d5f2-4031-8a61-1cfaaee66f5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:15.733762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328430-d5f2-4031-8a61-1cfaaee66f5e service swift] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:15.734023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328430-d5f2-4031-8a61-1cfaaee66f5e service swift] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:15.734445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328430-d5f2-4031-8a61-1cfaaee66f5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:15.745675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a328430-d5f2-4031-8a61-1cfaaee66f5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:15.747585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a328430-d5f2-4031-8a61-1cfaaee66f5e service swift] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:15.760898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1129/2278] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:49:16.172833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:16.194737 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9e343-e94d-4eab-be06-960dcf291d84 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:16.205212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:16.206696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:16.207088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:16.207639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:16.222882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:16.224533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:16.250248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1150/2279] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:16.967859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21a66-f175-4ab6-9163-b591a235dfad None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:16.968883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21a66-f175-4ab6-9163-b591a235dfad None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:16.969641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21a66-f175-4ab6-9163-b591a235dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:16.979602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:16.997261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-acd21a66-f175-4ab6-9163-b591a235dfad None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:16.998566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-acd21a66-f175-4ab6-9163-b591a235dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:17.022476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1130/2280] 10.222.0.45 () {58 vars in 967 bytes} [Tue Oct 4 08:49:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:17.038519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:17.051164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409e68c-47d0-4944-babd-370d6e807334 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:17.056572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:17.057288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:17.057632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:17.057971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:17.067982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:17.069659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:17.079203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1151/2281] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:49:17.463460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395c4a-dca4-4e8b-8b50-9c97cc93d9a6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:17.463985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395c4a-dca4-4e8b-8b50-9c97cc93d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:17.464256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395c4a-dca4-4e8b-8b50-9c97cc93d9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:17.484474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b6395c4a-dca4-4e8b-8b50-9c97cc93d9a6 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:17.485742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b6395c4a-dca4-4e8b-8b50-9c97cc93d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:17.493838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1131/2282] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:17.512339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:17.523786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1bd3f-3bdd-41ce-8361-e40b8452591e service swift] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:17.531001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:17.532009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:17.532812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:17.533324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:17.542981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:17.544769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:17.560920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1152/2283] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:49:17.949370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:17.949931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:17.949931 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:17.974314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:17.974314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:17.982170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1132/2284] 10.222.0.45 () {58 vars in 967 bytes} [Tue Oct 4 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:17.999353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:18.017297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0429-962f-4d29-a186-7ae3314645f1 service swift] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:18.023117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90398c-d40b-4593-bf44-62eeff8159c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:18.023739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90398c-d40b-4593-bf44-62eeff8159c0 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:18.024020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90398c-d40b-4593-bf44-62eeff8159c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:18.024293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90398c-d40b-4593-bf44-62eeff8159c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:18.034019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90398c-d40b-4593-bf44-62eeff8159c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:18.035682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90398c-d40b-4593-bf44-62eeff8159c0 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:18.044770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1153/2285] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:49:20.374220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:20.375678 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:20.445351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d147037-fd28-4391-a06e-26ec162a2eea None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:20.450158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:20.450798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:20.451082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:20.451357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] PATH_INFO: `/v3/users/a4fbf8526e714c8cb26c24c7ea8ff738` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:20.452520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fbf8526e714c8cb26c24c7ea8ff738)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:20.455242 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:20.521575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fbf8526e714c8cb26c24c7ea8ff738'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:20.522198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fbf8526e714c8cb26c24c7ea8ff738'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:20.530637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fbf8526e714c8cb26c24c7ea8ff738'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:20.539608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fbf8526e714c8cb26c24c7ea8ff738'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:20.540246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fbf8526e714c8cb26c24c7ea8ff738'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:20.573114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1133/2286] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:20 2022] DELETE /identity/v3/users/a4fbf8526e714c8cb26c24c7ea8ff738 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:20.573212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:20.573212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:20.573212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:20.590316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:20.591628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:20.711437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1154/2287] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:20.742466 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:20.743971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:20.909356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64f19-94d5-4f30-bc48-473848b3dc80 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:20.919997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:20.920629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:20.920980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:20.921753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:20.953515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:20.981231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:21.013484 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1134/2288] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:21.528451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:21.530346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:21.550850 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02912f15-4b5e-46b7-9ff4-4ef28d4bb38c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:21.581731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:21.583366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:21.583821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:21.585915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] PATH_INFO: `/v3/projects/18f51055736d4fe2b11e872c89821a05` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:21.588597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f51055736d4fe2b11e872c89821a05)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:21.602401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:21.604024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:21.609852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:21.624753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75641ab1-aa52-48fa-89b5-2c867ed8647a service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:21.635966 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f969383-5e60-4313-b857-7203214746de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:21.637909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f969383-5e60-4313-b857-7203214746de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:21.638166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f969383-5e60-4313-b857-7203214746de admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:21.638413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f969383-5e60-4313-b857-7203214746de admin admin] PATH_INFO: `/v3/users/9ad975b560c443e888abc6656c0ec3aa` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:21.644159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f969383-5e60-4313-b857-7203214746de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad975b560c443e888abc6656c0ec3aa)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:21.649315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f969383-5e60-4313-b857-7203214746de admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:21.651785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:21.693366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:21.715375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f51055736d4fe2b11e872c89821a05', 'request_id': 'req-7e511173-3270-4582-8ddc-b2c9181e2402'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.724896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f51055736d4fe2b11e872c89821a05', 'request_id': 'req-7e511173-3270-4582-8ddc-b2c9181e2402'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.731359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad975b560c443e888abc6656c0ec3aa'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.732025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad975b560c443e888abc6656c0ec3aa'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.738042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f51055736d4fe2b11e872c89821a05', 'request_id': 'req-7e511173-3270-4582-8ddc-b2c9181e2402'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.740773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad975b560c443e888abc6656c0ec3aa'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.749846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad975b560c443e888abc6656c0ec3aa'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.750652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad975b560c443e888abc6656c0ec3aa'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.755423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] The token cache is being invalidate because project 18f51055736d4fe2b11e872c89821a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:21.755814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.756530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7e511173-3270-4582-8ddc-b2c9181e2402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:21.758128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1155/2289] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:21 2022] DELETE /identity/v3/projects/18f51055736d4fe2b11e872c89821a05 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:21.784777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1135/2290] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:21 2022] DELETE /identity/v3/users/9ad975b560c443e888abc6656c0ec3aa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:49:21.790197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:21.790651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:21.791236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:21.822836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:21.824106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:21.921231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1156/2291] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:21.945223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:21.947016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:22.023839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f969383-5e60-4313-b857-7203214746de admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:22.027754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:22.028650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:22.029087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:22.029546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:22.042804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:22.045313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:22.060423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1136/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:22.570842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:22.572269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:22.586373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9371b8-ae2a-43df-9f9c-cc20a1866c79 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:22.591514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:22.592149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:22.592430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:22.592704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] PATH_INFO: `/v3/projects/8ee88831554141bfb8d7049000c09f2b` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:22.593892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee88831554141bfb8d7049000c09f2b)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:22.596224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:22.654020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee88831554141bfb8d7049000c09f2b', 'request_id': 'req-ecdf6095-a020-4067-acb2-cdf7d07c4f47'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.661751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee88831554141bfb8d7049000c09f2b', 'request_id': 'req-ecdf6095-a020-4067-acb2-cdf7d07c4f47'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.669809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee88831554141bfb8d7049000c09f2b', 'request_id': 'req-ecdf6095-a020-4067-acb2-cdf7d07c4f47'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.697465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] The token cache is being invalidate because project 8ee88831554141bfb8d7049000c09f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:22.698160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.698977 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.701043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1157/2293] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:22 2022] DELETE /identity/v3/projects/8ee88831554141bfb8d7049000c09f2b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:22.706336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:22.717808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbe49-65d5-491d-ae82-47c313d7e4a6 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:22.783497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:22.784352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:22.784814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:22.785256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] PATH_INFO: `/v3/users/92e22e1a08f74266bb44529b98414eb7` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:22.786578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e22e1a08f74266bb44529b98414eb7)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:22.788672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:22.824126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:22.858060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e22e1a08f74266bb44529b98414eb7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.858955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e22e1a08f74266bb44529b98414eb7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.869949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e22e1a08f74266bb44529b98414eb7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.879178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e22e1a08f74266bb44529b98414eb7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.880595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b9dc3424-e454-4a4c-8dd0-978bcfcf40ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e22e1a08f74266bb44529b98414eb7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:22.907965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1137/2294] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:22 2022] DELETE /identity/v3/users/92e22e1a08f74266bb44529b98414eb7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:49:23.440233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:23.441932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:23.455884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6095-a020-4067-acb2-cdf7d07c4f47 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:23.508557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:23.530322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:23.531330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:23.532405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:23.532701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] PATH_INFO: `/v3/projects/9031434605d14bd28157571af1d4f34c` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:23.533917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9031434605d14bd28157571af1d4f34c)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:23.536021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:23.603645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9031434605d14bd28157571af1d4f34c', 'request_id': 'req-f5b573f5-7904-4c89-9d28-df5584a8dfb9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:23.612710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9031434605d14bd28157571af1d4f34c', 'request_id': 'req-f5b573f5-7904-4c89-9d28-df5584a8dfb9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:23.625485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9031434605d14bd28157571af1d4f34c', 'request_id': 'req-f5b573f5-7904-4c89-9d28-df5584a8dfb9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:23.637715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] The token cache is being invalidate because project 9031434605d14bd28157571af1d4f34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:23.638001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:23.638662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f5b573f5-7904-4c89-9d28-df5584a8dfb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:23.640445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1158/2295] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:23 2022] DELETE /identity/v3/projects/9031434605d14bd28157571af1d4f34c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:23.647236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:23.647523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:23.647795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:23.670303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:23.671594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:23.750055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1138/2296] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:23.758682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:23.758980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:23.759225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:23.806026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:23.807275 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:23.816616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1159/2297] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:23.826260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:23.836946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bd95b-a062-479a-ad9a-218d725eebac None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:23.842062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:23.842673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:23.842952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:23.843251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:23.843909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:49:23.845079 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:23.847719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:23.864364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1139/2298] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:49:23.866038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:23.880611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e6d28-50fd-4302-abb5-0ab19ecf56ea None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:23.885729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:23.886337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:23.886620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:23.886887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:23.887529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:23.889501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:23.927691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:23.928995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1160/2299] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:49:23 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:23.939327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e589f-40f9-4ea8-9990-1d4b2d3f7ca7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:24.006614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:24.007162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:24.007587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:24.007939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:24.008539 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:24.010735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:24.035144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1140/2300] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:49:23 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:49:24.039312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:24.050070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042e371-cacc-488d-8cf9-11bbad60e592 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:24.055073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:24.055669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:24.055949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:24.056222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:24.056899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:24.058509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:24.068856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1161/2301] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:24.073260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:24.083916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782f4ef-798d-4b11-8cd8-7551d5234a3e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:24.088517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbc908-1699-475b-b351-c784a99683ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:24.089153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbc908-1699-475b-b351-c784a99683ff admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:24.089441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbc908-1699-475b-b351-c784a99683ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:24.089716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbc908-1699-475b-b351-c784a99683ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:24.090359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbc908-1699-475b-b351-c784a99683ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:24.091974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbc908-1699-475b-b351-c784a99683ff admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:24.108303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1141/2302] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:24.110173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:24.121789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb9cf-e627-4c82-8e62-c3ff92148561 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:24.127397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:24.128065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:24.128337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:24.128606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] PATH_INFO: `/v3/projects/07b08fbcc58944a2b11fc0cb5bafe588/users/49159cd4e30c407684bd26ee393232a9/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:24.144457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b08fbcc58944a2b11fc0cb5bafe588, user_id=49159cd4e30c407684bd26ee393232a9, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:24.147170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:24.161089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1162/2303] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:49:24 2022] PUT /identity/v3/projects/07b08fbcc58944a2b11fc0cb5bafe588/users/49159cd4e30c407684bd26ee393232a9/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:24.173396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:24.173683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:24.173963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:24.187597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:24.205711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] MFA Rules not processed for user `49159cd4e30c407684bd26ee393232a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:24.206993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:24.295455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1142/2304] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:24.313069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:24.316475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:24.400447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe459c8-7953-4ba3-8f1d-3d123dc7eb53 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:24.407388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f84206-cdc1-48be-8aaf-c31e608d9f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:24.409669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f84206-cdc1-48be-8aaf-c31e608d9f36 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:24.409962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f84206-cdc1-48be-8aaf-c31e608d9f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:24.410241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f84206-cdc1-48be-8aaf-c31e608d9f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:24.420448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f84206-cdc1-48be-8aaf-c31e608d9f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:24.421932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f84206-cdc1-48be-8aaf-c31e608d9f36 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:24.431906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1163/2305] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:30.426118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:30.512174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f87e-d0a0-4449-b17e-0b3136e3b59b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:30.519578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:30.520386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:30.520663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:30.521310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] PATH_INFO: `/v3/users/49159cd4e30c407684bd26ee393232a9` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:30.522581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49159cd4e30c407684bd26ee393232a9)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:30.524696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:30.581220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49159cd4e30c407684bd26ee393232a9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:30.581907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49159cd4e30c407684bd26ee393232a9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:30.590196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49159cd4e30c407684bd26ee393232a9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:30.600161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49159cd4e30c407684bd26ee393232a9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:30.601013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49159cd4e30c407684bd26ee393232a9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:30.622828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1143/2306] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:30 2022] DELETE /identity/v3/users/49159cd4e30c407684bd26ee393232a9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:30.628383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7877f-d43f-4f0a-8da0-9c61be02384e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:30.629072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7877f-d43f-4f0a-8da0-9c61be02384e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:30.629072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7877f-d43f-4f0a-8da0-9c61be02384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:30.649119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-36e7877f-d43f-4f0a-8da0-9c61be02384e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:30.650347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-36e7877f-d43f-4f0a-8da0-9c61be02384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:30.657216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:30.736862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1164/2307] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:30.754019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:30.755448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:30.779357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:30.835155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb683e-8159-4461-a7fe-87bb1d36af9f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:30.838957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:30.839817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:30.840101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:30.840372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:30.853205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:30.855075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:30.867389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1144/2308] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:31.212931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddbd30-8235-4bdd-b84b-aa29e05a0116 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.213396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddbd30-8235-4bdd-b84b-aa29e05a0116 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.213772 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddbd30-8235-4bdd-b84b-aa29e05a0116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.240689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-bbddbd30-8235-4bdd-b84b-aa29e05a0116 None None] MFA Rules not processed for user `0817f0d1febd445e8aeb0e897076f533`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:31.241950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bbddbd30-8235-4bdd-b84b-aa29e05a0116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:31.313994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1165/2309] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:31.430804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.432446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:31.447028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6476-1728-4a8a-9f68-6bf245bcf996 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.452006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.452951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.453411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.454134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] PATH_INFO: `/v3/projects/07b08fbcc58944a2b11fc0cb5bafe588` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.455859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b08fbcc58944a2b11fc0cb5bafe588)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:31.459329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:31.517172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b08fbcc58944a2b11fc0cb5bafe588', 'request_id': 'req-a20a78e5-c702-4317-8a40-783f25e87b45'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:31.525320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b08fbcc58944a2b11fc0cb5bafe588', 'request_id': 'req-a20a78e5-c702-4317-8a40-783f25e87b45'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:31.532144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b08fbcc58944a2b11fc0cb5bafe588', 'request_id': 'req-a20a78e5-c702-4317-8a40-783f25e87b45'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:31.543843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] The token cache is being invalidate because project 07b08fbcc58944a2b11fc0cb5bafe588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:31.544054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:31.545320 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-a20a78e5-c702-4317-8a40-783f25e87b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:31.548284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1145/2310] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:31 2022] DELETE /identity/v3/projects/07b08fbcc58944a2b11fc0cb5bafe588 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:31.553391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.553684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.553962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.575555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:31.576783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:31.642213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1166/2311] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:31.650131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.650415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.650687 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.672996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:31.674652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:31.683346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1146/2312] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:31.689872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.701923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426ef10-94d2-4e32-a725-242fd1546321 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.706899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.707670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.707989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.708391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.709084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:49:31.709387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:31.711027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:31.723795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1167/2313] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:49:31.728369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.739405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e50d-bc39-46d8-9e10-dd1b2c9d104f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.744366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.745007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.745292 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.745564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.746194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:31.748103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:31.777669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1147/2314] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:49:31 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:31.782487 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.792454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dfd2-cf9d-4ad1-b9e7-c8a818a23723 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.837015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:31.854014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.854630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.854914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.855194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.855847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:31.857885 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:31.886045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1168/2315] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:49:31 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:49:31.887366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.898699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9040-249b-41e3-97b5-ea447b556eb6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.904405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.905046 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.905389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.905601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.906304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:31.908589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:31.920660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1148/2316] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:31.926462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.939124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb69331-39e6-4f9c-a3fc-98e312112d0c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.943807 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4664df-ad72-4c50-800e-03a55b671f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.944680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4664df-ad72-4c50-800e-03a55b671f16 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.944680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4664df-ad72-4c50-800e-03a55b671f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.945039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4664df-ad72-4c50-800e-03a55b671f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:31.945531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4664df-ad72-4c50-800e-03a55b671f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:31.947786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4664df-ad72-4c50-800e-03a55b671f16 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:31.961901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1169/2317] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:49:31.966405 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:31.977904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16913d-e5a7-4022-a771-c60a92abe1c5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:31.986986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:31.987901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:31.988255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:31.988601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] PATH_INFO: `/v3/projects/64b307dc2794464eb7953dc4edc647bb/users/43974629067e42818bda93f06a027490/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:32.006656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b307dc2794464eb7953dc4edc647bb, user_id=43974629067e42818bda93f06a027490, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:32.009556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:32.024201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1149/2318] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:49:31 2022] PUT /identity/v3/projects/64b307dc2794464eb7953dc4edc647bb/users/43974629067e42818bda93f06a027490/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:32.035805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:32.036153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:32.036562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:32.070539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] MFA Rules not processed for user `43974629067e42818bda93f06a027490`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:32.071747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:32.147785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1170/2319] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:32.158880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:32.160615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:32.202493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:32.221423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc207e6-2f1d-4b2d-ad84-e7c7a9e492ed admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:32.225226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:32.225831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:32.226118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:32.226383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:32.236215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:32.237504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:32.247788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1150/2320] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:39.130643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:39.132607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:39.202979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44682a6e-ec90-4174-9d87-080d1d5c11dc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:39.208875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:39.209688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:39.210043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:39.210879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:39.212348 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:39.243724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:39.245217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:39.302932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:39.304994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf95d40-a147-4925-90e7-d5f69c5c0cfb service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:39.321471 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1171/2321] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:39.347841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6484703-ccba-4766-9429-b626f863c656 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:39.353179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:39.354125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:39.354601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:39.355074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] PATH_INFO: `/v3/users/631355cfafd04ecdae597ddf9b9f1ee4` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:39.356641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631355cfafd04ecdae597ddf9b9f1ee4)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:39.358978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:39.433852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631355cfafd04ecdae597ddf9b9f1ee4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:39.434542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631355cfafd04ecdae597ddf9b9f1ee4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:39.444430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631355cfafd04ecdae597ddf9b9f1ee4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:39.456705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631355cfafd04ecdae597ddf9b9f1ee4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:39.457806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631355cfafd04ecdae597ddf9b9f1ee4'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:39.482632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1151/2322] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:39 2022] DELETE /identity/v3/users/631355cfafd04ecdae597ddf9b9f1ee4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:49:39.488503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:39.489103 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:39.489619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:39.505015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:39.523303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:39.524564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:39.610262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1172/2323] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:49:39.652681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:39.654363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:39.722093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd3f0e-36db-4c52-9832-2b950a7e9079 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:39.726252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:39.727064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:39.727369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:39.727645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:39.741373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:39.745745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:39.757327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1152/2324] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:40.533044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:40.534617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:40.546786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b556fce-26f6-4591-b560-b44da2225186 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:40.552511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:40.553407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:40.553808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:40.554087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] PATH_INFO: `/v3/projects/87c8e1362e2647ab83c811abfa5db47f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:40.555238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c8e1362e2647ab83c811abfa5db47f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:40.557204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:40.620919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c8e1362e2647ab83c811abfa5db47f', 'request_id': 'req-fa418a9b-0231-405d-b143-1bb72c0c1192'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:40.628911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c8e1362e2647ab83c811abfa5db47f', 'request_id': 'req-fa418a9b-0231-405d-b143-1bb72c0c1192'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:40.637479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c8e1362e2647ab83c811abfa5db47f', 'request_id': 'req-fa418a9b-0231-405d-b143-1bb72c0c1192'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:40.649430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] The token cache is being invalidate because project 87c8e1362e2647ab83c811abfa5db47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:40.649726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:40.650381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa418a9b-0231-405d-b143-1bb72c0c1192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:40.651902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1173/2325] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:40 2022] DELETE /identity/v3/projects/87c8e1362e2647ab83c811abfa5db47f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:43.168871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:43.170386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:43.179109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:43.186076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cbdd3-9e68-474a-9db5-cf48b73b2333 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:43.247352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:43.247991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:43.248271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:43.248541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] PATH_INFO: `/v3/users/43974629067e42818bda93f06a027490` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:43.249718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=43974629067e42818bda93f06a027490)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:43.252158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:43.300424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43974629067e42818bda93f06a027490'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.301117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43974629067e42818bda93f06a027490'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.308085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43974629067e42818bda93f06a027490'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.315789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43974629067e42818bda93f06a027490'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.316671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43974629067e42818bda93f06a027490'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.335128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1153/2326] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:49:43 2022] DELETE /identity/v3/users/43974629067e42818bda93f06a027490 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:43.339665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:43.340181 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:43.340313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:43.361567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:43.362797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:43.425595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1174/2327] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:43.435435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:43.436921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:43.495513 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413c19-3353-4bc9-8bb0-516c300c4eaa admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:43.499182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d7d84-48d3-4ab7-80f4-5b5430b15ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:43.499793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d7d84-48d3-4ab7-80f4-5b5430b15ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:43.500084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d7d84-48d3-4ab7-80f4-5b5430b15ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:43.500354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d7d84-48d3-4ab7-80f4-5b5430b15ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:43.509924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d7d84-48d3-4ab7-80f4-5b5430b15ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:43.511363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d7d84-48d3-4ab7-80f4-5b5430b15ef2 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:43.521990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1154/2328] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:43.797572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:43.800196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:43.813450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99e9e-5d90-43a7-9aa8-d62689ccf878 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:43.818291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:43.818930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:43.819240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:43.819517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] PATH_INFO: `/v3/projects/64b307dc2794464eb7953dc4edc647bb` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:43.820671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b307dc2794464eb7953dc4edc647bb)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:43.823481 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:43.847596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:43.873090 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b307dc2794464eb7953dc4edc647bb', 'request_id': 'req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.879406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b307dc2794464eb7953dc4edc647bb', 'request_id': 'req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.887014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b307dc2794464eb7953dc4edc647bb', 'request_id': 'req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.897846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] The token cache is being invalidate because project 64b307dc2794464eb7953dc4edc647bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:49:43.898125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.898748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:49:43.900315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1175/2329] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:49:43 2022] DELETE /identity/v3/projects/64b307dc2794464eb7953dc4edc647bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:49:53.517185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:53.894605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:16.328775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:16.329385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:16.329385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:16.349167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:16.350381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:16.410041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1155/2330] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:50:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:16.432881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:16.434323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:16.505685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c67121-9a76-4dec-87cd-eaed1c7b5bc1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:16.512305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee9d18-a579-42f7-ba26-1148f53c6022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:16.512943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9d18-a579-42f7-ba26-1148f53c6022 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:16.513222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9d18-a579-42f7-ba26-1148f53c6022 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:16.513492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9d18-a579-42f7-ba26-1148f53c6022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:16.522436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee9d18-a579-42f7-ba26-1148f53c6022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:16.523952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee9d18-a579-42f7-ba26-1148f53c6022 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:16.531940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1176/2331] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:50:19.531613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:19.534345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:19.619413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d059ad6-e0c8-4261-994b-08d3d5be829c None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:19.637813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:19.638487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:19.638731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:19.639006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:19.641887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:19.662332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:19.666623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ce1a7-2e94-455d-99b2-38bfe3233987 service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:19.678938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1156/2332] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:50:26.528633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=32 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:29.674003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=57 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:31.481006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd602-7f11-40da-97d5-a7cfc688a163 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:31.482358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd602-7f11-40da-97d5-a7cfc688a163 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:31.482949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd602-7f11-40da-97d5-a7cfc688a163 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:31.485986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1177/2333] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:50:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:50:31.491669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda690c9-d2d9-4a8c-b13a-3c53d926c292 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:31.492198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda690c9-d2d9-4a8c-b13a-3c53d926c292 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:31.492198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda690c9-d2d9-4a8c-b13a-3c53d926c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:31.513635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cda690c9-d2d9-4a8c-b13a-3c53d926c292 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:31.515247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cda690c9-d2d9-4a8c-b13a-3c53d926c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:31.598794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1157/2334] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:31.614925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fd602-7f11-40da-97d5-a7cfc688a163 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:31.617401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-663fd602-7f11-40da-97d5-a7cfc688a163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:31.686411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fd602-7f11-40da-97d5-a7cfc688a163 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:31.691552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1618721-f3a2-49e5-bb07-e9a516d79a15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:31.692368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1618721-f3a2-49e5-bb07-e9a516d79a15 service glance] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:31.692694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1618721-f3a2-49e5-bb07-e9a516d79a15 service glance] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:31.693026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1618721-f3a2-49e5-bb07-e9a516d79a15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:31.705388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1618721-f3a2-49e5-bb07-e9a516d79a15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:31.706752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1618721-f3a2-49e5-bb07-e9a516d79a15 service glance] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:31.717783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1178/2335] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:50:31.790346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5238-4675-445e-aaa3-077cd14291d7 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:31.790634 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5238-4675-445e-aaa3-077cd14291d7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:31.790911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c5238-4675-445e-aaa3-077cd14291d7 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:31.792279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1158/2336] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:50:31.797215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52ba9-bb36-451a-83b0-e81e5c8cd203 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:31.797897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52ba9-bb36-451a-83b0-e81e5c8cd203 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:31.798378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52ba9-bb36-451a-83b0-e81e5c8cd203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:31.819385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b1e52ba9-bb36-451a-83b0-e81e5c8cd203 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:31.820740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b1e52ba9-bb36-451a-83b0-e81e5c8cd203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:31.876692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1179/2337] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:31.889026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5238-4675-445e-aaa3-077cd14291d7 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:31.890838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-eb8c5238-4675-445e-aaa3-077cd14291d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:31.904928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c5238-4675-445e-aaa3-077cd14291d7 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:31.908673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b83b5-6b78-44d0-a8ee-3402487e165b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:31.909315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b83b5-6b78-44d0-a8ee-3402487e165b service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:31.909598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b83b5-6b78-44d0-a8ee-3402487e165b service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:31.909873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b83b5-6b78-44d0-a8ee-3402487e165b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:31.919247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b83b5-6b78-44d0-a8ee-3402487e165b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:31.920851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b83b5-6b78-44d0-a8ee-3402487e165b service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:31.930410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1159/2338] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:50:32.017108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59ad0-ee9e-4c56-b341-92b390b07d32 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:32.017420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59ad0-ee9e-4c56-b341-92b390b07d32 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:32.017699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59ad0-ee9e-4c56-b341-92b390b07d32 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:32.019061 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1180/2339] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:50:32.024666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a34a9-7a6e-4d68-8353-314a90b83dc7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:32.024983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a34a9-7a6e-4d68-8353-314a90b83dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:32.025296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a34a9-7a6e-4d68-8353-314a90b83dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:32.047004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f57a34a9-7a6e-4d68-8353-314a90b83dc7 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:32.048984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f57a34a9-7a6e-4d68-8353-314a90b83dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:32.059775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1160/2340] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:50:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:32.071549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a59ad0-ee9e-4c56-b341-92b390b07d32 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:32.083231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a59ad0-ee9e-4c56-b341-92b390b07d32 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:32.086979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:32.087593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:32.087859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:32.088136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:32.099813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:32.101290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:32.114363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1181/2341] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:50:37.033448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636a217-4e23-4e42-8d94-997773e252b9 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:37.034514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636a217-4e23-4e42-8d94-997773e252b9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:37.034982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636a217-4e23-4e42-8d94-997773e252b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:37.062591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a636a217-4e23-4e42-8d94-997773e252b9 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:37.065618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a636a217-4e23-4e42-8d94-997773e252b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:37.077224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1161/2342] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:50:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:37.091932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:37.111744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fef85-2bf9-4e2e-a49b-610a57aa727c service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:37.123999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918bd7-ace3-4d37-8406-091f8564cc7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:37.124883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918bd7-ace3-4d37-8406-091f8564cc7d service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:37.125476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918bd7-ace3-4d37-8406-091f8564cc7d service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:37.126186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918bd7-ace3-4d37-8406-091f8564cc7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:37.153813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918bd7-ace3-4d37-8406-091f8564cc7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:37.159453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918bd7-ace3-4d37-8406-091f8564cc7d service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:37.177515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1182/2343] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:50:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:50:47.056566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=43 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:47.166368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=61 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:51.156330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:51.156890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:51.156990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:51.180195 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] MFA Rules not processed for user `f6f4f7ec5b174efb88287c751bd69365`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:51.181451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:51.239262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1162/2344] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:50:53.400530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b54c8-1577-4c6b-9eb2-6609f24c249b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:53.401123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b54c8-1577-4c6b-9eb2-6609f24c249b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:53.401123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b54c8-1577-4c6b-9eb2-6609f24c249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:53.421618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4b3b54c8-1577-4c6b-9eb2-6609f24c249b None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:53.422880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4b3b54c8-1577-4c6b-9eb2-6609f24c249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:53.431013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1183/2345] 10.222.0.45 () {58 vars in 967 bytes} [Tue Oct 4 08:50:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:53.443837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:53.455804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c410a1-1f01-4b02-ba44-1e74c513a45a None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:53.460738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f53e1-4c71-42e9-b89e-69d9fdffd377 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:53.461341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f53e1-4c71-42e9-b89e-69d9fdffd377 service swift] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:53.461619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f53e1-4c71-42e9-b89e-69d9fdffd377 service swift] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:53.461891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f53e1-4c71-42e9-b89e-69d9fdffd377 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:53.470707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f53e1-4c71-42e9-b89e-69d9fdffd377 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:53.472279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f53e1-4c71-42e9-b89e-69d9fdffd377 service swift] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:53.480161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1163/2346] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:03.416262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:03.477029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=31 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:07.974975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee300b-35dd-4ea5-991e-9a9a4a110d0a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:07.975528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee300b-35dd-4ea5-991e-9a9a4a110d0a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:07.975528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee300b-35dd-4ea5-991e-9a9a4a110d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:07.995034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b1ee300b-35dd-4ea5-991e-9a9a4a110d0a None None] MFA Rules not processed for user `0817f0d1febd445e8aeb0e897076f533`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:07.996228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b1ee300b-35dd-4ea5-991e-9a9a4a110d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:08.052343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1184/2347] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:51:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:18.044464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=25 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:35.485594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b99c4-42c1-4430-921f-159936ddb119 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:35.486121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b99c4-42c1-4430-921f-159936ddb119 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:35.486229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b99c4-42c1-4430-921f-159936ddb119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:35.505841 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a32b99c4-42c1-4430-921f-159936ddb119 None None] MFA Rules not processed for user `52d860c3943a48c5b693994cb45815f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:35.507055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a32b99c4-42c1-4430-921f-159936ddb119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:35.561312 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1164/2348] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:51:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:41.522489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab5119-e7e0-4715-b38d-43b76c17ad97 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.522995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab5119-e7e0-4715-b38d-43b76c17ad97 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.522995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab5119-e7e0-4715-b38d-43b76c17ad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.541794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2cab5119-e7e0-4715-b38d-43b76c17ad97 None None] MFA Rules not processed for user `0d79b76436a8435ea4718ef91c21c712`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:41.542987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2cab5119-e7e0-4715-b38d-43b76c17ad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:41.599656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1185/2349] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:45.554550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=25 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:51.590753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=25 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:01.302782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3ebda-37bb-4f10-b3b4-2ca3eddc980b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.303328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3ebda-37bb-4f10-b3b4-2ca3eddc980b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.303328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3ebda-37bb-4f10-b3b4-2ca3eddc980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.322637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-59a3ebda-37bb-4f10-b3b4-2ca3eddc980b None None] MFA Rules not processed for user `f6f4f7ec5b174efb88287c751bd69365`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:01.323834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-59a3ebda-37bb-4f10-b3b4-2ca3eddc980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.332482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1165/2350] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:09.187934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17fe9f-7a68-4c71-a371-f7355d0a1839 None None] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.188518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17fe9f-7a68-4c71-a371-f7355d0a1839 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.188917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17fe9f-7a68-4c71-a371-f7355d0a1839 None None] PATH_INFO: `/` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.190549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1186/2351] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:52:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:09.197159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cab0f-97c9-4e4b-9abb-6ba47bc7ce78 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.198027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cab0f-97c9-4e4b-9abb-6ba47bc7ce78 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.198306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cab0f-97c9-4e4b-9abb-6ba47bc7ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.235212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-4c0cab0f-97c9-4e4b-9abb-6ba47bc7ce78 None None] MFA Rules not processed for user `4b448cdeede24aa9bb0fc1a9f210b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:09.236810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4c0cab0f-97c9-4e4b-9abb-6ba47bc7ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:09.245924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1166/2352] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:09.268343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17fe9f-7a68-4c71-a371-f7355d0a1839 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.270441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bb17fe9f-7a68-4c71-a371-f7355d0a1839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:09.293753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17fe9f-7a68-4c71-a371-f7355d0a1839 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.297910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0532298-b823-4a6e-a5b9-5dc1328f5f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.298724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0532298-b823-4a6e-a5b9-5dc1328f5f59 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.299162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0532298-b823-4a6e-a5b9-5dc1328f5f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.299615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0532298-b823-4a6e-a5b9-5dc1328f5f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.307791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0532298-b823-4a6e-a5b9-5dc1328f5f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.309512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0532298-b823-4a6e-a5b9-5dc1328f5f59 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.320115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1187/2353] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:09.422905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196df17-e83c-4075-bb3c-c2b9b3d62e1b None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.423186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196df17-e83c-4075-bb3c-c2b9b3d62e1b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.423460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196df17-e83c-4075-bb3c-c2b9b3d62e1b None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.424824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1167/2354] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:09.430432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.430720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.431025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.453971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:09.454538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:09.463812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1188/2355] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:09.474695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196df17-e83c-4075-bb3c-c2b9b3d62e1b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.486373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196df17-e83c-4075-bb3c-c2b9b3d62e1b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.489900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.490493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.490852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.491037 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.501597 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.503011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.513620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1168/2356] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:13.776968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:13.791556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa8061-1742-4b68-9f5f-ab432763b3df None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:13.796419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:13.797969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:13.798673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:13.799409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:13.805462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:13.822998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:13.824511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:13.837404 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1189/2357] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:15.336572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:15.346831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68296225-bc47-4cba-ae8c-c85a213ebcd6 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:15.350762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:15.351639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:15.352667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:15.353209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:15.355614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:15.427179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:15.428636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:15.439444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1169/2358] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:15.566256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:15.574950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877d88-e5bb-4792-9f3d-12e1703512f5 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:15.579239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:15.579823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:15.580102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:15.580370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:15.582113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:15.596653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:15.598131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:15.609388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1190/2359] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:19.955800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:19.957287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:19.976419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715538-e57d-4f0a-80a8-730651f30abd service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:19.983846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:19.984595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:19.984982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:19.985389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] PATH_INFO: `/v3/users/0817f0d1febd445e8aeb0e897076f533` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:19.986689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0817f0d1febd445e8aeb0e897076f533)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:19.988702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.061993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0817f0d1febd445e8aeb0e897076f533'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.063003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0817f0d1febd445e8aeb0e897076f533'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.076099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0817f0d1febd445e8aeb0e897076f533'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.090023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0817f0d1febd445e8aeb0e897076f533'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.091141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5b7454e3-858b-4899-a0ca-e9544e3b4cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0817f0d1febd445e8aeb0e897076f533'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.121572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1170/2360] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:19 2022] DELETE /identity/v3/users/0817f0d1febd445e8aeb0e897076f533 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:20.322193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.334998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8e4c0-d6a2-4a57-9ca5-090236a87589 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.406065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.406717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.406993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.407272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] PATH_INFO: `/v3/projects/70a49f262cb54654b0613fad8daa2124` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.408414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a49f262cb54654b0613fad8daa2124)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.410480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.457192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a49f262cb54654b0613fad8daa2124', 'request_id': 'req-d395635c-ea17-4ddb-a451-d4f15f3175ea'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.463518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a49f262cb54654b0613fad8daa2124', 'request_id': 'req-d395635c-ea17-4ddb-a451-d4f15f3175ea'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.472704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a49f262cb54654b0613fad8daa2124', 'request_id': 'req-d395635c-ea17-4ddb-a451-d4f15f3175ea'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.484485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] The token cache is being invalidate because project 70a49f262cb54654b0613fad8daa2124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:20.484705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.485395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d395635c-ea17-4ddb-a451-d4f15f3175ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:20.486883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1191/2361] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:20 2022] DELETE /identity/v3/projects/70a49f262cb54654b0613fad8daa2124 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:20.492277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.492565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.492871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.513082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:20.514540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:20.548959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:20.575129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1171/2362] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:20.582672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.582953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.583231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.603927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:20.605183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:20.613795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1192/2363] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:20.618060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.627804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b68c5-38bf-4010-85ed-b84283a22208 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.632272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.632896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.633174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.633444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.634087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:20.634385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.636070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.652277 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1172/2364] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:20.657654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.666941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc064b-60d8-485e-9507-4c6adcd90919 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.672330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.672972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.673254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.673528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.674172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.676102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.703666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1193/2365] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:20 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:20.707780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.720530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb98a0-561b-40b7-8353-1767a66215da admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.784573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.785343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.785620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.785896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.786531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.788523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.812440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1173/2366] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:20 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:20.817040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.832596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf75f07-bc13-4621-8fc3-51fcffe363a2 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.838074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.838717 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.838991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.839264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.839917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.842587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.856508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1194/2367] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:20.862388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.875162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cb780-95f8-4f3f-86f3-06548610712e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.880066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b7a17-acb3-4cd0-a026-4f8f737c9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.880682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b7a17-acb3-4cd0-a026-4f8f737c9487 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.880995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b7a17-acb3-4cd0-a026-4f8f737c9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.881273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b7a17-acb3-4cd0-a026-4f8f737c9487 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.881923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b7a17-acb3-4cd0-a026-4f8f737c9487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.883537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b7a17-acb3-4cd0-a026-4f8f737c9487 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.895502 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1174/2368] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:20.899984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:20.907458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:20.911395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499947-b727-4607-a76f-ba0c14d0bd88 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.917692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.918440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.918739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.919236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] PATH_INFO: `/v3/projects/fcf69d2328c54845bb92aa1d637bb910/users/8108efb29b7e4b2399fd9216de39bae0/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.938365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf69d2328c54845bb92aa1d637bb910, user_id=8108efb29b7e4b2399fd9216de39bae0, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.941349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.955630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1195/2369] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:20 2022] PUT /identity/v3/projects/fcf69d2328c54845bb92aa1d637bb910/users/8108efb29b7e4b2399fd9216de39bae0/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:20.966542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.967126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.967126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.996270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] MFA Rules not processed for user `8108efb29b7e4b2399fd9216de39bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:20.997557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:21.068659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1175/2370] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:21.073254 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.142665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f7010-4209-4aba-a0fb-c8f60693edd4 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.147482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.148093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.148374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.148646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.149326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.151264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.180377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1196/2371] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:21 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:21.184591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.195508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67419d5e-6f6a-46bf-9021-cf9ee5ac40d3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.230901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:21.258300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.258919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.259204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.259479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.260130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.262111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.284309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1176/2372] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:21 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:21.288817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.299787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485bd97-5e8a-4141-8d5e-657f7271d426 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.304640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.305295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.305575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.305846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.306494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.308130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.320768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1197/2373] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:21.325594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.336888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1642e6-6c12-4f47-93ca-2dd5dd77a634 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.342039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.342728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.343012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.343291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] PATH_INFO: `/v3/projects/2f9bb99741b94eeb9a1c2290f68b47cc/users/0632d9ac939542248eb58c16fd0034e4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.363446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9bb99741b94eeb9a1c2290f68b47cc, user_id=0632d9ac939542248eb58c16fd0034e4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.363714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.379144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1177/2374] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:21 2022] PUT /identity/v3/projects/2f9bb99741b94eeb9a1c2290f68b47cc/users/0632d9ac939542248eb58c16fd0034e4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:21.383250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.396274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04107a3-b8c4-4d57-b28e-84b9fcd86754 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.465808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d13b4f-2fab-4870-93d8-407a65cbff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.466805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13b4f-2fab-4870-93d8-407a65cbff4b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.467081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13b4f-2fab-4870-93d8-407a65cbff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.467441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d13b4f-2fab-4870-93d8-407a65cbff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.468082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13b4f-2fab-4870-93d8-407a65cbff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.469707 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d13b4f-2fab-4870-93d8-407a65cbff4b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.479687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1198/2375] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:21.484857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.495337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34a4a-982f-4151-8226-5eaedccb56af admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.501075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.501744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.502053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.502338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] PATH_INFO: `/v3/projects/2f9bb99741b94eeb9a1c2290f68b47cc/users/0632d9ac939542248eb58c16fd0034e4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.504349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9bb99741b94eeb9a1c2290f68b47cc, user_id=0632d9ac939542248eb58c16fd0034e4, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.507026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.518707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1178/2376] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:21 2022] PUT /identity/v3/projects/2f9bb99741b94eeb9a1c2290f68b47cc/users/0632d9ac939542248eb58c16fd0034e4/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:21.530651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.530939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.531229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.564989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] MFA Rules not processed for user `0632d9ac939542248eb58c16fd0034e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:21.566213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:21.610176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:21.641578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1199/2377] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:21.653775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.655901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:21.718757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592833-baa2-49af-a708-93b70f466333 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.722657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59f14-ef27-4b17-892a-016f7e2aad27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.723285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59f14-ef27-4b17-892a-016f7e2aad27 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.723568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59f14-ef27-4b17-892a-016f7e2aad27 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.723839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59f14-ef27-4b17-892a-016f7e2aad27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.734359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f59f14-ef27-4b17-892a-016f7e2aad27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.735828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f59f14-ef27-4b17-892a-016f7e2aad27 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.746527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1179/2378] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:22.212463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:22.275872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85869cd2-a860-4deb-a253-9ddcb8294af6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:22.281077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:22.281726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:22.282003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:22.282273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] PATH_INFO: `/v3/users/8108efb29b7e4b2399fd9216de39bae0` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:22.283367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8108efb29b7e4b2399fd9216de39bae0)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:22.285346 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:22.332361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8108efb29b7e4b2399fd9216de39bae0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.333055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8108efb29b7e4b2399fd9216de39bae0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.340259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8108efb29b7e4b2399fd9216de39bae0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.341216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8108efb29b7e4b2399fd9216de39bae0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.349245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8108efb29b7e4b2399fd9216de39bae0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.370775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1200/2379] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:22 2022] DELETE /identity/v3/users/8108efb29b7e4b2399fd9216de39bae0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:22.376069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:22.376589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:22.376589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:22.397870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:22.399070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:22.465276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1180/2380] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:22.475860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:22.477336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:22.656518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c497d-b2b5-48cf-b1ce-2a1a49d2945b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:22.660024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:22.660839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:22.661113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:22.661377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:22.671957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:22.673443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:22.677311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:22.685172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1201/2381] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:22.954964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:22.956780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:22.971268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7754c-a2cb-47f3-bb94-f5c579a5e448 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:22.976493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:22.977262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:22.977951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:22.977951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] PATH_INFO: `/v3/projects/fcf69d2328c54845bb92aa1d637bb910` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:22.979250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf69d2328c54845bb92aa1d637bb910)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:22.981418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:23.014441 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:23.032993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf69d2328c54845bb92aa1d637bb910', 'request_id': 'req-bf578046-89d4-4898-8dd8-ff48cc6f13b9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.041200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf69d2328c54845bb92aa1d637bb910', 'request_id': 'req-bf578046-89d4-4898-8dd8-ff48cc6f13b9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.047791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf69d2328c54845bb92aa1d637bb910', 'request_id': 'req-bf578046-89d4-4898-8dd8-ff48cc6f13b9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.058200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] The token cache is being invalidate because project fcf69d2328c54845bb92aa1d637bb910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:23.058490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.059135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.063438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1181/2382] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:22 2022] DELETE /identity/v3/projects/fcf69d2328c54845bb92aa1d637bb910 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:23.064683 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:23.074265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfef48-b49c-4bd3-9aba-95c196c98ed5 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:23.134099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:23.134732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:23.135009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:23.135276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] PATH_INFO: `/v3/users/0632d9ac939542248eb58c16fd0034e4` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:23.136389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0632d9ac939542248eb58c16fd0034e4)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:23.138865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:23.184696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0632d9ac939542248eb58c16fd0034e4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.185380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0632d9ac939542248eb58c16fd0034e4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.192218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0632d9ac939542248eb58c16fd0034e4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.192873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0632d9ac939542248eb58c16fd0034e4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.200629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-af34c541-ed2b-45f7-bef2-506c987a98c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0632d9ac939542248eb58c16fd0034e4'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.219035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1202/2383] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:23 2022] DELETE /identity/v3/users/0632d9ac939542248eb58c16fd0034e4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:23.567450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:23.568929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:23.585180 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578046-89d4-4898-8dd8-ff48cc6f13b9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:23.646645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:23.647283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:23.647559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:23.647826 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] PATH_INFO: `/v3/projects/2f9bb99741b94eeb9a1c2290f68b47cc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:23.649005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9bb99741b94eeb9a1c2290f68b47cc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:23.651055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:23.708707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9bb99741b94eeb9a1c2290f68b47cc', 'request_id': 'req-39d16b09-bb52-4c23-9330-295673692696'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.718702 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9bb99741b94eeb9a1c2290f68b47cc', 'request_id': 'req-39d16b09-bb52-4c23-9330-295673692696'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.725836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9bb99741b94eeb9a1c2290f68b47cc', 'request_id': 'req-39d16b09-bb52-4c23-9330-295673692696'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.737353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] The token cache is being invalidate because project 2f9bb99741b94eeb9a1c2290f68b47cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:23.737645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.738286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-39d16b09-bb52-4c23-9330-295673692696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:23.739776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1182/2384] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:23 2022] DELETE /identity/v3/projects/2f9bb99741b94eeb9a1c2290f68b47cc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:23.744857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:23.745326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:23.745560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:23.765837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:23.767170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:23.829979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1203/2385] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:23.837990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:23.838271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:23.838541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:23.988210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:23.989375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:23.997267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1183/2386] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:24.002266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.012227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb224739-55b9-4bda-9a97-8a8cd4206511 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.017199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.017846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.018121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.018389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.019066 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:24.019364 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.020994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.033661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1204/2387] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:24.038373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.049150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d9406-c8e1-4bf6-baa3-a6ee20a729d0 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.053913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.054542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.054816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.055087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.055715 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.057710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.085219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1184/2388] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:24.089630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.096856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:24.100548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1638-056c-4397-adf2-8a6def438617 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.164114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.164742 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.165023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.165298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.165924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.167841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.189127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1205/2389] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:24.193265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.203645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32862559-c9ce-41ec-8156-b7773cc6484f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.208196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.208980 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.209260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.209532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.210175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.211770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.222619 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1185/2390] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:24.226843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.238633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fdd28-784b-447c-8341-91dc3e2d3199 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.243264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed732fc0-41c6-4871-922a-7c17d05b9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.243905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732fc0-41c6-4871-922a-7c17d05b9e95 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.244184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732fc0-41c6-4871-922a-7c17d05b9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.244456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732fc0-41c6-4871-922a-7c17d05b9e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.245184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed732fc0-41c6-4871-922a-7c17d05b9e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.246776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed732fc0-41c6-4871-922a-7c17d05b9e95 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.257178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1206/2391] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:24.261335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.267921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:24.271818 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ee229-60f5-4b5e-9e0b-3e32d9937184 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.277663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.278523 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.279586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.279871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] PATH_INFO: `/v3/projects/e92d68707a84409a8d141731385a615e/users/ec3a392ea453456bbe1b19d0e55f1e00/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.297045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92d68707a84409a8d141731385a615e, user_id=ec3a392ea453456bbe1b19d0e55f1e00, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.300831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.315366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1186/2392] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:24 2022] PUT /identity/v3/projects/e92d68707a84409a8d141731385a615e/users/ec3a392ea453456bbe1b19d0e55f1e00/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:24.328036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.328428 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.328827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.362477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] MFA Rules not processed for user `ec3a392ea453456bbe1b19d0e55f1e00`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:24.363703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:24.437755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1207/2393] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:24.442262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.505436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202644d-a8bf-4038-abb5-b7e43a5b9984 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.510224 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.510836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.511105 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.511384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.512027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.514266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.540852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1187/2394] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:24.545543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.556366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec603c-27d9-4064-953c-eda03bd7a394 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.614499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.615112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.615392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.615663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.616289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.618253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.642701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1208/2395] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:24.646965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.657289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fc08-1e83-49e1-aec1-10fb1474f4cf admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.661913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.662509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.662790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.663065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.663696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.665319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.675822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1188/2396] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:24.680023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.686272 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:24.692617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c55de-583d-4b60-a32e-d737c1ac6952 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.697406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc27bf-5522-4ad2-a3c1-d55a2ed4510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.698002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc27bf-5522-4ad2-a3c1-d55a2ed4510f admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.698279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc27bf-5522-4ad2-a3c1-d55a2ed4510f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.698549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc27bf-5522-4ad2-a3c1-d55a2ed4510f admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.699188 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc27bf-5522-4ad2-a3c1-d55a2ed4510f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.700852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc27bf-5522-4ad2-a3c1-d55a2ed4510f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.711163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1209/2397] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:24.715429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.725573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b3090-d366-49c0-aa18-00c404f590ef admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.730278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.730920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.731198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.731470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] PATH_INFO: `/v3/projects/270b2abc6ea24fba88aee4da70c5aeb6/users/8ec2854d7fea4e999f27dc4718fab844/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.746677 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=270b2abc6ea24fba88aee4da70c5aeb6, user_id=8ec2854d7fea4e999f27dc4718fab844, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.750064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.763020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1189/2398] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:24 2022] PUT /identity/v3/projects/270b2abc6ea24fba88aee4da70c5aeb6/users/8ec2854d7fea4e999f27dc4718fab844/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:24.773488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.773979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.774077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.803536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] MFA Rules not processed for user `8ec2854d7fea4e999f27dc4718fab844`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:24.804770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:24.870330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1210/2399] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:24.875067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.936613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd2baf-5acf-415d-b029-4830ca6633ea admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.942041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.942649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.942927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.943197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.943837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.945790 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.975249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1190/2400] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:24.980241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.993810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591cc58-3833-4ff2-a97f-d56a37e1771c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.049622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.050226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.050505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.050777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.051399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.053351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.077472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1211/2401] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:24 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:25.081714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.093090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf89b-1f5c-4f2f-9da3-365a2f994af8 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.098395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.099035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.099317 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.099592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.100240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.101891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.117485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1191/2402] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:25.121960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.134302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06b7b-166c-4174-bc93-626b24df284f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.139510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.140178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.140458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.140756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] PATH_INFO: `/v3/projects/469018f7ad0c45958f7114ffd23ba3fe/users/cb0e690a354d4b69b426aee8a86532c6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.156443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469018f7ad0c45958f7114ffd23ba3fe, user_id=cb0e690a354d4b69b426aee8a86532c6, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.159201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.173418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1212/2403] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:25 2022] PUT /identity/v3/projects/469018f7ad0c45958f7114ffd23ba3fe/users/cb0e690a354d4b69b426aee8a86532c6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:25.177535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.183842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:25.188527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfeacd-e8fa-4204-99d0-42b573db4137 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.247336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaaec4-2bfa-4164-b60d-49caf6233385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.248299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaaec4-2bfa-4164-b60d-49caf6233385 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.248647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaaec4-2bfa-4164-b60d-49caf6233385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.248977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaaec4-2bfa-4164-b60d-49caf6233385 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.249621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaaec4-2bfa-4164-b60d-49caf6233385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.251249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaaec4-2bfa-4164-b60d-49caf6233385 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.261080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1192/2404] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:25.266351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.281924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c3439-f02b-4a97-bab2-3a80710652b1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.293936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.294624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.294901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.295177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] PATH_INFO: `/v3/projects/469018f7ad0c45958f7114ffd23ba3fe/users/cb0e690a354d4b69b426aee8a86532c6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.297121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469018f7ad0c45958f7114ffd23ba3fe, user_id=cb0e690a354d4b69b426aee8a86532c6, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.299821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.310574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1213/2405] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:25 2022] PUT /identity/v3/projects/469018f7ad0c45958f7114ffd23ba3fe/users/cb0e690a354d4b69b426aee8a86532c6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:25.320887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.321214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.321487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.357072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] MFA Rules not processed for user `cb0e690a354d4b69b426aee8a86532c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:25.358504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.426674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1193/2406] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:25.437527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.439263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.475204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:25.498377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306e7d9-f52c-419e-b01e-2e218566d1d0 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.502032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.502635 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.502914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.503184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.512157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.514373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.524032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1214/2407] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:26.031275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.032737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:26.044589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd1253-3ff3-4c27-bbcf-cc9692b67780 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.048109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.048708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.049024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.049293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.107983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.109442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.118871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1194/2408] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:29.337964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:29.350983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eff47-7e77-4dad-91a3-06f72ade3654 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:29.357022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:29.357649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:29.357927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:29.358229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:29.360023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:29.396390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:29.405229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7d63a-a253-4c43-9aa4-49576a6bd5bf service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:29.408950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:29.409557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:29.409834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:29.410102 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:29.411867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:29.422819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:29.423196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:29.424268 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:29.424946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:29.433685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1215/2409] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:29.434480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1195/2410] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:30.164930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:30.174169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5c86-e351-46cc-9705-78d1d40dc232 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:30.177777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217767-7288-4abd-841b-6a14d569e88b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:30.178371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217767-7288-4abd-841b-6a14d569e88b service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:30.178651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217767-7288-4abd-841b-6a14d569e88b service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:30.178919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217767-7288-4abd-841b-6a14d569e88b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:30.237123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217767-7288-4abd-841b-6a14d569e88b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:30.238527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217767-7288-4abd-841b-6a14d569e88b service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:30.247601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1216/2411] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:32.425487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.438943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:32.496635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc7cf-a489-4623-bf66-36ccbd95f0c4 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.501907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.502558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.502835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.503106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] PATH_INFO: `/v3/users/ec3a392ea453456bbe1b19d0e55f1e00` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.504294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3a392ea453456bbe1b19d0e55f1e00)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.506256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.564060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3a392ea453456bbe1b19d0e55f1e00'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:32.564786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3a392ea453456bbe1b19d0e55f1e00'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:32.571775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3a392ea453456bbe1b19d0e55f1e00'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:32.580772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3a392ea453456bbe1b19d0e55f1e00'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:32.581564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3a392ea453456bbe1b19d0e55f1e00'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:32.599632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1196/2412] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:32 2022] DELETE /identity/v3/users/ec3a392ea453456bbe1b19d0e55f1e00 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:32.604391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.604953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.605051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.624964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:32.626171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:32.692832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1217/2413] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:32.703203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.704638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:32.763163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96787ce-44f5-4d00-91e2-9db380d9184a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.766673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.767278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.767557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.767822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.777090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.778688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.788318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1197/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:33.053107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.054732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.069219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7c308-4ea4-4efa-b3ee-bdf8b00e0df8 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.074171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.074881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.075267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.075733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] PATH_INFO: `/v3/projects/e92d68707a84409a8d141731385a615e` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.077002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92d68707a84409a8d141731385a615e)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.078954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.089071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:33.136855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92d68707a84409a8d141731385a615e', 'request_id': 'req-13145285-ac8d-4548-b69f-07031c32b1ad'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.144201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92d68707a84409a8d141731385a615e', 'request_id': 'req-13145285-ac8d-4548-b69f-07031c32b1ad'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.154483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92d68707a84409a8d141731385a615e', 'request_id': 'req-13145285-ac8d-4548-b69f-07031c32b1ad'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.165063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] The token cache is being invalidate because project e92d68707a84409a8d141731385a615e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:33.165350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.165978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.167452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1218/2415] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:33 2022] DELETE /identity/v3/projects/e92d68707a84409a8d141731385a615e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:33.172289 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.182370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d644fd-4c5e-4922-81a8-84493c3e8736 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.211968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:33.242829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.243474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.243754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.244026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] PATH_INFO: `/v3/users/8ec2854d7fea4e999f27dc4718fab844` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.245212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec2854d7fea4e999f27dc4718fab844)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.247448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.293512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec2854d7fea4e999f27dc4718fab844'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.294793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec2854d7fea4e999f27dc4718fab844'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.301913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec2854d7fea4e999f27dc4718fab844'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.309073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec2854d7fea4e999f27dc4718fab844'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.309775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec2854d7fea4e999f27dc4718fab844'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.327367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1198/2416] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:33 2022] DELETE /identity/v3/users/8ec2854d7fea4e999f27dc4718fab844 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:33.640704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.642316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.656408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13145285-ac8d-4548-b69f-07031c32b1ad admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.718678 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.719307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.719583 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.719853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] PATH_INFO: `/v3/projects/270b2abc6ea24fba88aee4da70c5aeb6` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.721077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=270b2abc6ea24fba88aee4da70c5aeb6)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.722994 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.770443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270b2abc6ea24fba88aee4da70c5aeb6', 'request_id': 'req-a72ee60a-0750-464c-813e-3e483acceadb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.777001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270b2abc6ea24fba88aee4da70c5aeb6', 'request_id': 'req-a72ee60a-0750-464c-813e-3e483acceadb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.785305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270b2abc6ea24fba88aee4da70c5aeb6', 'request_id': 'req-a72ee60a-0750-464c-813e-3e483acceadb'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.798360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] The token cache is being invalidate because project 270b2abc6ea24fba88aee4da70c5aeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:33.798645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.799303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.800842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1219/2417] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:33 2022] DELETE /identity/v3/projects/270b2abc6ea24fba88aee4da70c5aeb6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:33.804884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.806669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.820410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf91-fcdc-432d-a47d-8efd33341c39 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.881375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.882016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.882291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.882563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] PATH_INFO: `/v3/users/cb0e690a354d4b69b426aee8a86532c6` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.883695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0e690a354d4b69b426aee8a86532c6)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.885653 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.939771 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0e690a354d4b69b426aee8a86532c6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.940448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0e690a354d4b69b426aee8a86532c6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.945746 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:33.947664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0e690a354d4b69b426aee8a86532c6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.960278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0e690a354d4b69b426aee8a86532c6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.961643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-b52e5b86-445b-49a7-a8d1-bea588025f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0e690a354d4b69b426aee8a86532c6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:33.981107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1199/2418] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:33 2022] DELETE /identity/v3/users/cb0e690a354d4b69b426aee8a86532c6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:34.258665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.260234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:34.273337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ee60a-0750-464c-813e-3e483acceadb admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.299177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:34.333859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.334488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.334825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.335192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] PATH_INFO: `/v3/projects/469018f7ad0c45958f7114ffd23ba3fe` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.336452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=469018f7ad0c45958f7114ffd23ba3fe)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.338425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.384913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469018f7ad0c45958f7114ffd23ba3fe', 'request_id': 'req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:34.390944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469018f7ad0c45958f7114ffd23ba3fe', 'request_id': 'req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:34.398603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469018f7ad0c45958f7114ffd23ba3fe', 'request_id': 'req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:34.409610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] The token cache is being invalidate because project 469018f7ad0c45958f7114ffd23ba3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:34.409895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:34.410515 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e60aaf5e-f6e1-476d-aac7-0544ee63a69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:34.411979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1220/2419] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:34 2022] DELETE /identity/v3/projects/469018f7ad0c45958f7114ffd23ba3fe => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:34.418052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.418341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.419786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.439618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:34.440844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:34.504608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1200/2420] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:34.513813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.514091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.514383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.534852 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:34.536155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:34.544855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1221/2421] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:34.549232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.558901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de33a4-22fb-407d-8d26-5bc41a90ad45 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.563684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.564376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.564557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.564866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.565522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:34.565825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.567412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.582284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1201/2422] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:52:34.583726 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.594258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad996d60-51fd-47e2-a393-35b7e971cf1e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.599329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.600223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.600682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.601164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.602119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.604465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.634991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1222/2423] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:34 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:34.639821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.651695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54bb92-0213-4773-9293-8cba8d049ab6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.717679 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.718284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.718564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.718833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.719465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.721399 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.742652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1202/2424] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:34 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:34.746771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.757128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b244-570f-422a-9261-efba8032e749 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.761699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.762288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.763186 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.763363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.763997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.765619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.775401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1223/2425] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:34.779934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.790283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf666396-0efd-422d-8992-e74243728263 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.795426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c05724-d383-4627-b9b4-ea87e9c67136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.796020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c05724-d383-4627-b9b4-ea87e9c67136 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.796297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c05724-d383-4627-b9b4-ea87e9c67136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.796566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c05724-d383-4627-b9b4-ea87e9c67136 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.797246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c05724-d383-4627-b9b4-ea87e9c67136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.798832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c05724-d383-4627-b9b4-ea87e9c67136 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.808755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1203/2426] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:34.813242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:34.823200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d6290-f4f7-4618-9085-e840597ed924 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:34.828192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:34.828863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.829136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.829432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] PATH_INFO: `/v3/projects/e4371f7cf1a843928514f49fbe38d662/users/2575d17d76c44075a09a4e68549739df/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.845333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4371f7cf1a843928514f49fbe38d662, user_id=2575d17d76c44075a09a4e68549739df, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:34.848071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:34.861835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1224/2427] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:34 2022] PUT /identity/v3/projects/e4371f7cf1a843928514f49fbe38d662/users/2575d17d76c44075a09a4e68549739df/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:34.873203 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:34.873491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:34.873764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:34.904439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] MFA Rules not processed for user `2575d17d76c44075a09a4e68549739df`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:34.905788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:34.938085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:34.985625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1204/2428] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:34.986884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.042051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:35.055483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ee923-c5cc-4899-a429-5310208b4de5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.061349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.061960 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.062237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.062513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.063142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.065086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.099771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1225/2429] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:34 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:35.100839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.124260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e795f9b-798a-402c-8c63-b08741f3e034 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.192560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.193284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.193563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.193835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.194476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.196400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.222287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1205/2430] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:35 2022] POST /identity/v3/users => generated 301 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:35.223561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.234323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c152-1b5e-4d21-ab89-c680981c7cdf admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.238914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.239509 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.239797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.240073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.240708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.242339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.253456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1226/2431] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:35.257671 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.268910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24709b4-2507-4e5a-9a5e-b8473b442759 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.273673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.274325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.274606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.274879 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] PATH_INFO: `/v3/projects/d584d60a65a3466bbbca218bc2a876fe/users/a63d2b41bba4491baff2d45a201c4461/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.290555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d584d60a65a3466bbbca218bc2a876fe, user_id=a63d2b41bba4491baff2d45a201c4461, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.294362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.308314 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1206/2432] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:35 2022] PUT /identity/v3/projects/d584d60a65a3466bbbca218bc2a876fe/users/a63d2b41bba4491baff2d45a201c4461/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:35.313184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.323112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa400b-3c2d-4d34-9c2d-231797d64e0a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.380552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a2220-4316-42ad-9810-8306c9647382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.381097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a2220-4316-42ad-9810-8306c9647382 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.381373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a2220-4316-42ad-9810-8306c9647382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.381640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a2220-4316-42ad-9810-8306c9647382 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.382271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a2220-4316-42ad-9810-8306c9647382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.384083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a2220-4316-42ad-9810-8306c9647382 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.393924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1227/2433] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:35.398147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.408385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2369f-e2aa-4db2-bb01-583ad6fd7b6b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.412982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.413631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.413911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.414186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] PATH_INFO: `/v3/projects/d584d60a65a3466bbbca218bc2a876fe/users/a63d2b41bba4491baff2d45a201c4461/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.416088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d584d60a65a3466bbbca218bc2a876fe, user_id=a63d2b41bba4491baff2d45a201c4461, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.419376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.429644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1207/2434] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:35 2022] PUT /identity/v3/projects/d584d60a65a3466bbbca218bc2a876fe/users/a63d2b41bba4491baff2d45a201c4461/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:35.441265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.441551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.441823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.469342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] MFA Rules not processed for user `a63d2b41bba4491baff2d45a201c4461`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:35.470544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:35.542367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1228/2435] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:35.553293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.555071 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:35.612202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b566f8-a926-407c-b48d-6eb52c625f9a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.615784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a409-3acd-4319-9b2b-1e1d69bf5028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.616388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a409-3acd-4319-9b2b-1e1d69bf5028 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.616692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a409-3acd-4319-9b2b-1e1d69bf5028 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.616993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a409-3acd-4319-9b2b-1e1d69bf5028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.625741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0a409-3acd-4319-9b2b-1e1d69bf5028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.627167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0a409-3acd-4319-9b2b-1e1d69bf5028 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.636612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1208/2436] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:35.779714 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.827389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:35.843398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213ab4-198b-4b71-9cbf-90a0990a90e4 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.849337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.850115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.850526 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.850919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] PATH_INFO: `/v3/users/2575d17d76c44075a09a4e68549739df` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.852146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2575d17d76c44075a09a4e68549739df)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.854232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.906485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2575d17d76c44075a09a4e68549739df'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:35.907057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2575d17d76c44075a09a4e68549739df'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:35.915039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2575d17d76c44075a09a4e68549739df'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:35.915890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2575d17d76c44075a09a4e68549739df'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:35.925763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2575d17d76c44075a09a4e68549739df'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:35.955668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1229/2437] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:35 2022] DELETE /identity/v3/users/2575d17d76c44075a09a4e68549739df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:35.960246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.960772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.960891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.981840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:35.983278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:36.002092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:36.052707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1209/2438] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:36.063773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:36.065251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:36.124450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7245e4-a9bd-408e-831b-422ca54c1d6c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:36.128091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:36.128701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:36.129000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:36.129265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:36.138738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:36.140153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:36.149711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1230/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:36.435868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:36.437467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:36.453201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5b1c9-208d-462b-b508-a88567c3711b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:36.459082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:36.459838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:36.460232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:36.460573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] PATH_INFO: `/v3/projects/e4371f7cf1a843928514f49fbe38d662` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:36.461845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4371f7cf1a843928514f49fbe38d662)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:36.464123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:36.536824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4371f7cf1a843928514f49fbe38d662', 'request_id': 'req-d2933bca-7dcd-4149-93cf-d404fe128589'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.545391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4371f7cf1a843928514f49fbe38d662', 'request_id': 'req-d2933bca-7dcd-4149-93cf-d404fe128589'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.551968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4371f7cf1a843928514f49fbe38d662', 'request_id': 'req-d2933bca-7dcd-4149-93cf-d404fe128589'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.562447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] The token cache is being invalidate because project e4371f7cf1a843928514f49fbe38d662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:36.562735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.563382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.564860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1210/2440] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:36 2022] DELETE /identity/v3/projects/e4371f7cf1a843928514f49fbe38d662 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:36.568964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:36.578759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca47516-fbcd-4f7d-a18c-4415636ab3af service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:36.636224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:36.636907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:36.637187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:36.637479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] PATH_INFO: `/v3/users/a63d2b41bba4491baff2d45a201c4461` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:36.638826 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63d2b41bba4491baff2d45a201c4461)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:36.640760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:36.652769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:36.690324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63d2b41bba4491baff2d45a201c4461'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.690908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63d2b41bba4491baff2d45a201c4461'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.697753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63d2b41bba4491baff2d45a201c4461'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.698377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63d2b41bba4491baff2d45a201c4461'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.705925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-cbca94a6-103e-4f3a-9537-7049a07743b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63d2b41bba4491baff2d45a201c4461'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:36.724176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1231/2441] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:36 2022] DELETE /identity/v3/users/a63d2b41bba4491baff2d45a201c4461 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:37.027758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.030200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.050242 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2933bca-7dcd-4149-93cf-d404fe128589 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.114208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.114846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.115129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.115404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] PATH_INFO: `/v3/projects/d584d60a65a3466bbbca218bc2a876fe` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.116559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d584d60a65a3466bbbca218bc2a876fe)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.118525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.166248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:37.167730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd584d60a65a3466bbbca218bc2a876fe', 'request_id': 'req-8f2a1b54-743a-4fc8-b4a8-225fc7428856'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:37.175664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd584d60a65a3466bbbca218bc2a876fe', 'request_id': 'req-8f2a1b54-743a-4fc8-b4a8-225fc7428856'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:37.182263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd584d60a65a3466bbbca218bc2a876fe', 'request_id': 'req-8f2a1b54-743a-4fc8-b4a8-225fc7428856'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:37.192569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] The token cache is being invalidate because project d584d60a65a3466bbbca218bc2a876fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:37.192890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:37.193526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-8f2a1b54-743a-4fc8-b4a8-225fc7428856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:37.194997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1211/2442] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:37 2022] DELETE /identity/v3/projects/d584d60a65a3466bbbca218bc2a876fe => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:37.199866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.200895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.200995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.221898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:37.223055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.282052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1232/2443] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:37.289705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.289992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.290263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.310994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:37.312196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.319957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1212/2444] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:37.324179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.334868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f3927-bd43-4d6f-8063-691a76f00641 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.339499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.340054 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.340339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.340915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.341946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:37.342250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.343861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.355576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1233/2445] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:37.359973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.369345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a37df-2c15-475d-87d5-14f9654dbcef None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.374910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.375534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.375810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.376081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.376701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.378616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.407298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1213/2446] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:37 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:37.411545 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.421708 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11043-f8ff-4c3f-a343-8a14e0b0c53c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.477947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.478453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.478730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.478999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.479633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.481684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.502887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1234/2447] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:37 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:37.507097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.518005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f47597-5456-44a8-be4c-adbfc345aa40 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.522538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.524660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.524660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.524660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.524660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.525878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.541248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1214/2448] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:37.545454 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.555502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a39f4-fae0-4408-81fd-4419aedf7ee0 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.560806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dab39-8f02-46a7-a2ef-612edcd5a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.561413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dab39-8f02-46a7-a2ef-612edcd5a847 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.561693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dab39-8f02-46a7-a2ef-612edcd5a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.561965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dab39-8f02-46a7-a2ef-612edcd5a847 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.562612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dab39-8f02-46a7-a2ef-612edcd5a847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.564208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dab39-8f02-46a7-a2ef-612edcd5a847 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.565632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:37.579276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1235/2449] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:37.583287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.594217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9717a4-dca4-4ebd-b267-d4ce1491fb8e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.598940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.599592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.599873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.600145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] PATH_INFO: `/v3/projects/19cbc00d3f904580a06ef463bd659996/users/f9e16a281729451aab038c6a0ce23eae/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.615874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19cbc00d3f904580a06ef463bd659996, user_id=f9e16a281729451aab038c6a0ce23eae, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.618571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.639612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1215/2450] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:37 2022] PUT /identity/v3/projects/19cbc00d3f904580a06ef463bd659996/users/f9e16a281729451aab038c6a0ce23eae/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:37.649988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.650276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.650542 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.679480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] MFA Rules not processed for user `f9e16a281729451aab038c6a0ce23eae`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:37.680760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.749686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1236/2451] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:37.760136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.761855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.821828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3dd23-a872-4614-ad6c-55c3fd7ad89a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.826235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c15a-d670-485f-beeb-d4f22eb98eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.826842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c15a-d670-485f-beeb-d4f22eb98eef service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.827123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c15a-d670-485f-beeb-d4f22eb98eef service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.827401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c15a-d670-485f-beeb-d4f22eb98eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.836437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c15a-d670-485f-beeb-d4f22eb98eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.838057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c15a-d670-485f-beeb-d4f22eb98eef service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.848408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1216/2452] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:40.925466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:41.027446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed839d7-a470-4b3f-998b-c1122cd6b7fa None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:41.034627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:41.035319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:41.035599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:41.035869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] PATH_INFO: `/v3/users/f9e16a281729451aab038c6a0ce23eae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:41.038855 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e16a281729451aab038c6a0ce23eae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:41.043312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:41.129774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e16a281729451aab038c6a0ce23eae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.130605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e16a281729451aab038c6a0ce23eae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.143117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e16a281729451aab038c6a0ce23eae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.144192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e16a281729451aab038c6a0ce23eae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.155615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e16a281729451aab038c6a0ce23eae'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.204162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1237/2453] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:40 2022] DELETE /identity/v3/users/f9e16a281729451aab038c6a0ce23eae => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:41.206488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:41.208407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:41.208693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:41.242361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:41.244371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:41.349324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1217/2454] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:41.361368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:41.362914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:41.370407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:41.482647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7759ed7-52b5-411c-bd3a-a32e3a12715b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:41.486963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad722dd0-f1ac-4d38-a8c2-8b27adf0cca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:41.487702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad722dd0-f1ac-4d38-a8c2-8b27adf0cca5 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:41.488043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad722dd0-f1ac-4d38-a8c2-8b27adf0cca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:41.488370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad722dd0-f1ac-4d38-a8c2-8b27adf0cca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:41.499215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad722dd0-f1ac-4d38-a8c2-8b27adf0cca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:41.500817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad722dd0-f1ac-4d38-a8c2-8b27adf0cca5 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:41.510748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1238/2455] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:41.853658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:41.855325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:41.870952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41056ed-399f-4faf-beba-90da5eaf1df5 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:41.882073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:41.882726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:41.883001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:41.883367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] PATH_INFO: `/v3/projects/19cbc00d3f904580a06ef463bd659996` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:41.884609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19cbc00d3f904580a06ef463bd659996)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:41.886550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:41.898953 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:41.945534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19cbc00d3f904580a06ef463bd659996', 'request_id': 'req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.953182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19cbc00d3f904580a06ef463bd659996', 'request_id': 'req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.959793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19cbc00d3f904580a06ef463bd659996', 'request_id': 'req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.971889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] The token cache is being invalidate because project 19cbc00d3f904580a06ef463bd659996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:41.972189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.972896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0b9f3406-c5e0-48b4-bdd7-7edca28e377b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:41.974801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1218/2456] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:41 2022] DELETE /identity/v3/projects/19cbc00d3f904580a06ef463bd659996 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:41.979512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:41.980014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:41.980114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.001811 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:42.003160 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:42.070568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1239/2457] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:42.080577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.080909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.081192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.102174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:42.103319 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:42.112763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1219/2458] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:42.117028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.127385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be850-8a47-4f94-806f-2ccff1498472 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.132281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.132941 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.133217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.133492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.134148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:42.134450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.136083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.149056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1240/2459] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:42.154108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.163478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379b5be-2161-497a-82b1-ebcdbe4fcbf4 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.168226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.169005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.169285 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.169565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.170217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.172120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.201256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1220/2460] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:42.205482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.217816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30880-eddc-4b09-b7a3-89900328cf8c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.275277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.275870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.276146 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.276416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.277076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.279733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.304508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1241/2461] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:42.308946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.319348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f0228-0aab-4dfb-aea1-46d59d818a1a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.323961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.324553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.325380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.325657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.326288 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.327873 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.338109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1221/2462] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:42.343043 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.354986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985eb3-0d3f-4104-b0e3-b7fdbe41efa5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.359998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66caba4-ed93-4f58-aea5-fdb78a287a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.360614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66caba4-ed93-4f58-aea5-fdb78a287a05 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.361029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66caba4-ed93-4f58-aea5-fdb78a287a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.361303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66caba4-ed93-4f58-aea5-fdb78a287a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.361976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66caba4-ed93-4f58-aea5-fdb78a287a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.363642 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66caba4-ed93-4f58-aea5-fdb78a287a05 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.375092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1242/2463] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:42.379479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.391035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79d751-962b-4bb3-a2a8-a745a13fc3d7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.395868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.396521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.396835 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.397112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] PATH_INFO: `/v3/projects/2664f884d5ea465a81df529a2d55ebaa/users/ac36981bb32a490fb2efc5914ec9e0cd/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.414234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2664f884d5ea465a81df529a2d55ebaa, user_id=ac36981bb32a490fb2efc5914ec9e0cd, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.417221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.433238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1222/2464] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:42 2022] PUT /identity/v3/projects/2664f884d5ea465a81df529a2d55ebaa/users/ac36981bb32a490fb2efc5914ec9e0cd/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:42.444350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.444636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.444955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.473253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:42.478099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] MFA Rules not processed for user `ac36981bb32a490fb2efc5914ec9e0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:42.479602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:42.549668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1243/2465] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:42.554436 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.623728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f591d09-7975-4794-99c9-b126f51ffe89 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.628250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.628898 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.629178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.629449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.630199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.632215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.659379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1223/2466] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:42.663381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.674072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14806e2d-0b23-4e81-a310-48634a5c47d1 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.730736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.731435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.731705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.731970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.732596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.734547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.755951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1244/2467] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:42.759991 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.771210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c873a0-6446-4fcf-9c1d-56851b1ed85d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.777072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.777817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.778156 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.778474 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.779181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.780846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.792371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1224/2468] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:42.796563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.806610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0796-f039-45e8-a09d-d06b80d1846a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.814882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229418a7-5867-4913-9295-e2e5bf994077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.815450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229418a7-5867-4913-9295-e2e5bf994077 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.815730 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229418a7-5867-4913-9295-e2e5bf994077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.816000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229418a7-5867-4913-9295-e2e5bf994077 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.816646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229418a7-5867-4913-9295-e2e5bf994077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.818342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229418a7-5867-4913-9295-e2e5bf994077 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.830713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1245/2469] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:42.834885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:42.849510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1433-c7bb-4ed6-9132-e6a3fbf4a3bd admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:42.854731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:42.855395 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.855708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.856707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] PATH_INFO: `/v3/projects/0b1aba7417c64d9ba4b4ab56446c64ef/users/7a77e4c474664446a4bc06d777de9123/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.861053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:42.874227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1aba7417c64d9ba4b4ab56446c64ef, user_id=7a77e4c474664446a4bc06d777de9123, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:42.877158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:42.891901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1225/2470] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:42 2022] PUT /identity/v3/projects/0b1aba7417c64d9ba4b4ab56446c64ef/users/7a77e4c474664446a4bc06d777de9123/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:42.902357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:42.902648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:42.903685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:42.932258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] MFA Rules not processed for user `7a77e4c474664446a4bc06d777de9123`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:42.933671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:43.017554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1246/2471] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:43.023233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.092838 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f19ab-2e52-4144-ae73-875a967c6a45 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.099236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.100001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.100413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.100793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.101510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.108101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.144844 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1226/2472] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:43.148586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.164461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61431cee-5453-4f5a-9648-b5c7beff70f0 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.175895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:43.236614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.237266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.237541 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.237809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.238867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.240380 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.267399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1247/2473] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:43 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:43.268744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.284606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c463a0-fa40-44fd-9777-d3b9fae1e47e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.290212 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.290880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.291222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.291491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.292155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.294450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.305581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1227/2474] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:43.312965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.331025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c27e1-0b40-4e5f-bbeb-9b3e194d172a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.337746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.338430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.338769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.339163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] PATH_INFO: `/v3/projects/db0f9b96dd374dc5a68e82cec91fac3d/users/6b0e80823bc44de6a61f9a551c20b4e6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.364762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f9b96dd374dc5a68e82cec91fac3d, user_id=6b0e80823bc44de6a61f9a551c20b4e6, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.367980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.383320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1248/2475] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:43 2022] PUT /identity/v3/projects/db0f9b96dd374dc5a68e82cec91fac3d/users/6b0e80823bc44de6a61f9a551c20b4e6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:43.387282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.408819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac92f-de13-472b-a88a-9cc0d4bd0637 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.471131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c8bd5-378e-46a8-adf3-286c5cbc682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.471747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c8bd5-378e-46a8-adf3-286c5cbc682d admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.472000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c8bd5-378e-46a8-adf3-286c5cbc682d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.472272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c8bd5-378e-46a8-adf3-286c5cbc682d admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.472940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c8bd5-378e-46a8-adf3-286c5cbc682d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.474534 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c8bd5-378e-46a8-adf3-286c5cbc682d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.485743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1228/2476] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:43.489957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.502504 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eaeb4-a4f4-489c-b25d-f7ca788f1740 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.509201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.509879 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.510271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.510482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] PATH_INFO: `/v3/projects/db0f9b96dd374dc5a68e82cec91fac3d/users/6b0e80823bc44de6a61f9a551c20b4e6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.513664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f9b96dd374dc5a68e82cec91fac3d, user_id=6b0e80823bc44de6a61f9a551c20b4e6, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.516350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.527516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1249/2477] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:43 2022] PUT /identity/v3/projects/db0f9b96dd374dc5a68e82cec91fac3d/users/6b0e80823bc44de6a61f9a551c20b4e6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:43.596412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.596704 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.597013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.645402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] MFA Rules not processed for user `6b0e80823bc44de6a61f9a551c20b4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:43.646538 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:43.697003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:43.728225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1229/2478] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:43.741549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.743252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:43.804556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f4c9-4c91-4436-a526-ae01b7873590 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.808231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.808884 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.809191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.809514 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.870185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.871661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.882012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1250/2479] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:45.405069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:45.414578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd4e5-29ae-45d8-9c17-1979f62815b6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:45.418106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:45.419464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:45.419738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:45.420005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:45.474950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:45.476366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:45.485757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1230/2480] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:46.047134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:46.057072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b25f79-989c-43eb-97b9-a482bacbaa10 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:46.061685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:46.062298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:46.062609 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:46.062902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:46.073323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:46.075310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:46.085519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1251/2481] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:47.212304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:47.214182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.273775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d443f-e244-4303-a794-ca358ab8657a service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:47.277413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:47.278095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.278593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.278895 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.280697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.345157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:47.346606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32658980-b28e-4833-a2f9-a40198e9bb9a service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:47.357592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1231/2482] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:50.137426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:50.150979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:50.159126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f325e-c191-4390-91d1-37409d374d45 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:50.164329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:50.165262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:50.165759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:50.166223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] PATH_INFO: `/v3/users/ac36981bb32a490fb2efc5914ec9e0cd` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:50.167579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac36981bb32a490fb2efc5914ec9e0cd)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:50.170639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:50.228041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac36981bb32a490fb2efc5914ec9e0cd'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:50.229257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac36981bb32a490fb2efc5914ec9e0cd'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:50.238878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac36981bb32a490fb2efc5914ec9e0cd'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:50.239647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac36981bb32a490fb2efc5914ec9e0cd'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:50.249557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac36981bb32a490fb2efc5914ec9e0cd'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:50.277517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1252/2483] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:50 2022] DELETE /identity/v3/users/ac36981bb32a490fb2efc5914ec9e0cd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:50.282287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:50.282794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:50.282892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:50.302528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:50.303988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:50.331386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:50.368916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1232/2484] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:50.379571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:50.381089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:50.457838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840eed-7cc8-4776-bbca-ba6a2281f03f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:50.461858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:50.462477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:50.462756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:50.463029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:50.473041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:50.474498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:50.485418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1253/2485] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:51.050890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.052511 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:51.067598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cf79f-3f1a-4b30-b883-7d3cbace4a03 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.074006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.075351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.075632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.075956 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] PATH_INFO: `/v3/projects/2664f884d5ea465a81df529a2d55ebaa` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.084567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2664f884d5ea465a81df529a2d55ebaa)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.086582 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:51.150782 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2664f884d5ea465a81df529a2d55ebaa', 'request_id': 'req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.160096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2664f884d5ea465a81df529a2d55ebaa', 'request_id': 'req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.167891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2664f884d5ea465a81df529a2d55ebaa', 'request_id': 'req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.179326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] The token cache is being invalidate because project 2664f884d5ea465a81df529a2d55ebaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:51.179520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.180090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.181640 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1233/2486] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/projects/2664f884d5ea465a81df529a2d55ebaa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:51.186248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.196372 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f348a6-d438-46cb-a495-881390a26a1f service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.267229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.268649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:51.270014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.270668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.270950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.271224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] PATH_INFO: `/v3/users/7a77e4c474664446a4bc06d777de9123` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.272410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a77e4c474664446a4bc06d777de9123)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.274382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:51.283021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da909c7-5c3f-4548-8aa0-3260d19f4bf5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.288252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.288926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.289211 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.289490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] PATH_INFO: `/v3/users/52d860c3943a48c5b693994cb45815f7` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.290631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d860c3943a48c5b693994cb45815f7)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.292604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:51.299546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:51.332501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a77e4c474664446a4bc06d777de9123'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.333176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a77e4c474664446a4bc06d777de9123'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.341605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a77e4c474664446a4bc06d777de9123'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.342294 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a77e4c474664446a4bc06d777de9123'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.347753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d860c3943a48c5b693994cb45815f7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.348476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d860c3943a48c5b693994cb45815f7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.351251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a77e4c474664446a4bc06d777de9123'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.356303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d860c3943a48c5b693994cb45815f7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.366413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d860c3943a48c5b693994cb45815f7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.367201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d860c3943a48c5b693994cb45815f7'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.376325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1254/2487] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/users/7a77e4c474664446a4bc06d777de9123 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:51.388909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1234/2488] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/users/52d860c3943a48c5b693994cb45815f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:51.626136 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.627725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:51.707361 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614828b-6e82-4621-85ec-2ec52554d0ee admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.726181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.727622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:51.767527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:51.780474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.781141 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.781423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.781794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] PATH_INFO: `/v3/projects/9189457f94be4cf99979395d5cc4bc80` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.782998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9189457f94be4cf99979395d5cc4bc80)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.784997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:51.808516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63869-c24e-4933-ac96-5e211d2ebb16 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.813920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.814761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.815054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.815422 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] PATH_INFO: `/v3/projects/0b1aba7417c64d9ba4b4ab56446c64ef` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.816663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1aba7417c64d9ba4b4ab56446c64ef)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.818843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:51.838842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:51.840651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9189457f94be4cf99979395d5cc4bc80', 'request_id': 'req-776e9c4b-ec32-41d0-9105-adcf32849444'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.849313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9189457f94be4cf99979395d5cc4bc80', 'request_id': 'req-776e9c4b-ec32-41d0-9105-adcf32849444'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.858026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9189457f94be4cf99979395d5cc4bc80', 'request_id': 'req-776e9c4b-ec32-41d0-9105-adcf32849444'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.868965 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] The token cache is being invalidate because project 9189457f94be4cf99979395d5cc4bc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:51.869253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.869891 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-776e9c4b-ec32-41d0-9105-adcf32849444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.871393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1255/2489] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/projects/9189457f94be4cf99979395d5cc4bc80 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:51.874787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1aba7417c64d9ba4b4ab56446c64ef', 'request_id': 'req-23d41fdc-4361-46b9-9313-48db3fb5dfa5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.876837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b468-69e5-464a-8daa-0ecf98327412 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.877129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b468-69e5-464a-8daa-0ecf98327412 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.877400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b468-69e5-464a-8daa-0ecf98327412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.883431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1aba7417c64d9ba4b4ab56446c64ef', 'request_id': 'req-23d41fdc-4361-46b9-9313-48db3fb5dfa5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.890459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1aba7417c64d9ba4b4ab56446c64ef', 'request_id': 'req-23d41fdc-4361-46b9-9313-48db3fb5dfa5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.898345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8543b468-69e5-464a-8daa-0ecf98327412 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:51.899618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8543b468-69e5-464a-8daa-0ecf98327412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:51.901617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] The token cache is being invalidate because project 0b1aba7417c64d9ba4b4ab56446c64ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:51.901910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.902743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:51.904629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1235/2490] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/projects/0b1aba7417c64d9ba4b4ab56446c64ef => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:51.908490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.909904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:51.964408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1256/2491] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:51.972221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.972501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.972801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.984669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41fdc-4361-46b9-9313-48db3fb5dfa5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.989342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.989984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.990263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.990537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] PATH_INFO: `/v3/users/6b0e80823bc44de6a61f9a551c20b4e6` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.991656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0e80823bc44de6a61f9a551c20b4e6)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.993633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:51.994525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:51.995755 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.007801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1257/2492] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:52.008664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.020130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cfbb-6a46-4793-820e-a1c81b419453 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.025413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.026206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.026523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.026819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.027465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:52.027764 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.029448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.047170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1258/2493] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:52.048185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.057549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0e80823bc44de6a61f9a551c20b4e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.058300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0e80823bc44de6a61f9a551c20b4e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.058573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bc36e-3881-45e5-a0bb-f9f54b69006d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.066615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0e80823bc44de6a61f9a551c20b4e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.067027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.067644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.067922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.068316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:52.069031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.069793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.073002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.077885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0e80823bc44de6a61f9a551c20b4e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.079499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0e80823bc44de6a61f9a551c20b4e6'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.104472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1259/2494] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:52.109123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.110889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.112732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1236/2495] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/users/6b0e80823bc44de6a61f9a551c20b4e6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:52.190921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c097-5580-4297-99f7-09492b283b0d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.241162 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:52.262139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.262873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.263149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.263423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.264052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.266167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.289449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1260/2496] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:52.294199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.305175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ccb73-528a-4821-80f2-0483750d4a1d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.310250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.310860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.311138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.311408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.312050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.313883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.326802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1237/2497] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:52.331073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.342460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ee11-d51e-4408-bd95-7e5ab6fb1db1 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.347100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caccc8-1373-4fa6-ba3c-73b99fd1fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.347715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caccc8-1373-4fa6-ba3c-73b99fd1fe03 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.347995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caccc8-1373-4fa6-ba3c-73b99fd1fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.348900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caccc8-1373-4fa6-ba3c-73b99fd1fe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.349119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caccc8-1373-4fa6-ba3c-73b99fd1fe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.350765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caccc8-1373-4fa6-ba3c-73b99fd1fe03 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.364841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1261/2498] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:52.366151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.376243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07020e72-1cb0-4a0f-b406-abc3f3457b14 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.380963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.381613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.381889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.382193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] PATH_INFO: `/v3/projects/e08c4e51da7f4358b60be3af9ef42258/users/e2fda02f11e444eb8ac11e4797d0e934/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.397461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08c4e51da7f4358b60be3af9ef42258, user_id=e2fda02f11e444eb8ac11e4797d0e934, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.400085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.414951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1238/2499] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:52 2022] PUT /identity/v3/projects/e08c4e51da7f4358b60be3af9ef42258/users/e2fda02f11e444eb8ac11e4797d0e934/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:52.427800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.428094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.428358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.445055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.446853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.458513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] MFA Rules not processed for user `e2fda02f11e444eb8ac11e4797d0e934`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:52.459744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.521328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc69274-6d49-4197-ada2-784751ad131e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.526181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.526820 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.527110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.527376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] PATH_INFO: `/v3/projects/db0f9b96dd374dc5a68e82cec91fac3d` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.529124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0f9b96dd374dc5a68e82cec91fac3d)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.531060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.531490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1262/2500] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:52.543017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.545485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.578497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0f9b96dd374dc5a68e82cec91fac3d', 'request_id': 'req-12c825b3-da02-4b4e-adfb-23261c55894a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.587293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0f9b96dd374dc5a68e82cec91fac3d', 'request_id': 'req-12c825b3-da02-4b4e-adfb-23261c55894a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.595273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0f9b96dd374dc5a68e82cec91fac3d', 'request_id': 'req-12c825b3-da02-4b4e-adfb-23261c55894a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.607858 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] The token cache is being invalidate because project db0f9b96dd374dc5a68e82cec91fac3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:52.608137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.608860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-12c825b3-da02-4b4e-adfb-23261c55894a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.610362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1239/2501] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:52 2022] DELETE /identity/v3/projects/db0f9b96dd374dc5a68e82cec91fac3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:52.616231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b31e6-c84f-4cad-8fe3-cfc5a19924dc None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.616529 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b31e6-c84f-4cad-8fe3-cfc5a19924dc None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.617029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b31e6-c84f-4cad-8fe3-cfc5a19924dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.623671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937ce53-aceb-40ee-bddd-3755c1d6f333 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.638901 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d26b31e6-c84f-4cad-8fe3-cfc5a19924dc None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:52.640124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d26b31e6-c84f-4cad-8fe3-cfc5a19924dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.664916 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:52.674533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:52.694533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.695155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.695441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.695712 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.697506 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.704600 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1240/2502] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:52.712645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.712959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.713231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.733642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:52.734761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.742710 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1241/2503] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:52.746821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.756137 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757f28-c7b2-4e44-8b2d-25d762cff51b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.759674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.761394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.762823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.763434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.763718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.763983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.764626 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:52.764961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.766544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.772167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1263/2504] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:52.779489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1242/2505] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:52:52.784261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.795414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884beda-b78c-4fc7-8345-3db4f5bc8494 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.800701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.801353 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.801633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.801907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.802561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.804473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.832870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1264/2506] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:52.837149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.849014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655bce4-eb6e-4429-a6cf-9a5321575d92 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.911920 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.912705 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.913106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.913500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.914354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.916363 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.939713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1243/2507] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:52.944420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.956278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445f36-024b-4a4c-a984-649e426597fd admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.962665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.963300 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.963599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.963916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.964544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.967295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.978861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1265/2508] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:52.983512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.994440 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422668-9ae2-4244-8bf3-b9f73dbe537e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:53.000592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e13b17-e6f6-4f5f-98e0-b38437d648ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:53.001287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e13b17-e6f6-4f5f-98e0-b38437d648ce admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:53.001520 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e13b17-e6f6-4f5f-98e0-b38437d648ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:53.001868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e13b17-e6f6-4f5f-98e0-b38437d648ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:53.002652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e13b17-e6f6-4f5f-98e0-b38437d648ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:53.004249 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e13b17-e6f6-4f5f-98e0-b38437d648ce admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:53.015743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1244/2509] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:53.020530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:53.031568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6360d2-c3fd-4fb6-864c-c9e6366c71cc admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:53.036527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:53.037207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:53.037485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:53.037759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] PATH_INFO: `/v3/projects/fb561461347d4c789911696e8686350d/users/19caf7c7cc1b4c74a4e5b73e61a2bf07/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:53.064004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb561461347d4c789911696e8686350d, user_id=19caf7c7cc1b4c74a4e5b73e61a2bf07, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:53.066952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:53.083921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1266/2510] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:53 2022] PUT /identity/v3/projects/fb561461347d4c789911696e8686350d/users/19caf7c7cc1b4c74a4e5b73e61a2bf07/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:53.088863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:53.089151 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:53.089424 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:53.113341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:53.119480 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:53.188583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1245/2511] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:53.198217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:53.200785 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:53.262147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0428e-d75d-4aa5-855b-e2a1c76a1d77 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:53.267070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:53.267685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:53.268015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:53.268286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:53.277619 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:53.279557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:53.289616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1267/2512] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:56.738569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.740029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:56.774792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:56.841990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe3279-91a0-4bbb-8709-bdcd6965721d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.850032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.850668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.852430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.852810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.857282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:56.945773 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.951801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3d88a-73ff-472c-879b-576b82695763 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.961908 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1246/2513] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:58.223203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.223203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:58.240058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b1e7-fbe5-4d61-bd86-edeece0a196d service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:58.250750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:58.251561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.252023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.252571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] PATH_INFO: `/v3/users/e2fda02f11e444eb8ac11e4797d0e934` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.253821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fda02f11e444eb8ac11e4797d0e934)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:58.255962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:58.295152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:58.328147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fda02f11e444eb8ac11e4797d0e934'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:58.328851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fda02f11e444eb8ac11e4797d0e934'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:58.336527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fda02f11e444eb8ac11e4797d0e934'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:58.337426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fda02f11e444eb8ac11e4797d0e934'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:58.348375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-54f6b02d-3f21-425b-b20b-dcb51d8df945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fda02f11e444eb8ac11e4797d0e934'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:58.375073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1268/2514] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:58 2022] DELETE /identity/v3/users/e2fda02f11e444eb8ac11e4797d0e934 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:58.382183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.382732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.382819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.385220 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.385780 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.386266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.414453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:58.416149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:58.436540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] MFA Rules not processed for user `19caf7c7cc1b4c74a4e5b73e61a2bf07`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:58.437791 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:58.514256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1269/2515] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:58.520957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.523105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:58.544801 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1247/2516] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:58.549339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.551417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:58.570058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48e80c-7293-4c20-8527-edb4eb4e0c4b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:58.576015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:58.576789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.577192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.577568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.578316 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:58.580522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:58.597234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c87d-159d-45a3-8655-12ae470ad573 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:58.602192 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:58.602820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.603078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.603561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.614282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1248/2517] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:58 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:58.618568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:58.618735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.620745 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:58.633531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1270/2518] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:58.667271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:58.722338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b487-c947-4e2d-995f-6b9c86d66f37 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:58.729387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:58.730570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.731073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.731489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.732219 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:58.734688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:58.773635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1249/2519] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:58 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:58.778385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.803152 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea471f-60a5-41e9-9e0b-d2e2ebe51345 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:58.819044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:58.822259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.822535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.826467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.827695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:58.829690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:58.874771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1271/2520] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:58.876307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.888286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4431ab-e2e3-46d2-8e17-b84fa5642392 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:58.895035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:58.896169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:58.896535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:58.896900 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] PATH_INFO: `/v3/projects/c31f3102e2f04ade83ba2ef48e2f5b77/users/8a90dbee17d347c5bce28b88715cb88a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:58.918977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31f3102e2f04ade83ba2ef48e2f5b77, user_id=8a90dbee17d347c5bce28b88715cb88a, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:58.922238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:58.948810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1250/2521] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:58 2022] PUT /identity/v3/projects/c31f3102e2f04ade83ba2ef48e2f5b77/users/8a90dbee17d347c5bce28b88715cb88a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:58.950140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:58.963357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb2b7-b277-42da-80c4-5a7447c614ff admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.006592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:59.023590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.025451 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:59.061299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.061944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.062117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.062390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.063040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.064673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.076218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1272/2522] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:59.080224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.091763 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9be82c-fd1d-4c45-bbf2-0f289d540054 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.098632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9924ed9-ffe1-4a8b-b601-74c40c5172db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.098840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924ed9-ffe1-4a8b-b601-74c40c5172db admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.099039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924ed9-ffe1-4a8b-b601-74c40c5172db admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.099329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9924ed9-ffe1-4a8b-b601-74c40c5172db admin admin] PATH_INFO: `/v3/projects/c31f3102e2f04ade83ba2ef48e2f5b77/users/8a90dbee17d347c5bce28b88715cb88a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.101332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9924ed9-ffe1-4a8b-b601-74c40c5172db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31f3102e2f04ade83ba2ef48e2f5b77, user_id=8a90dbee17d347c5bce28b88715cb88a, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.104500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9924ed9-ffe1-4a8b-b601-74c40c5172db admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.119191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1273/2523] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:59 2022] PUT /identity/v3/projects/c31f3102e2f04ade83ba2ef48e2f5b77/users/8a90dbee17d347c5bce28b88715cb88a/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:59.131551 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af046a1b-7f90-413a-be34-456f8e7cb330 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.215823 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.217107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.217107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.217570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] PATH_INFO: `/v3/projects/e08c4e51da7f4358b60be3af9ef42258` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.218843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08c4e51da7f4358b60be3af9ef42258)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.221159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.273816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:59.275462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08c4e51da7f4358b60be3af9ef42258', 'request_id': 'req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:59.287014 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08c4e51da7f4358b60be3af9ef42258', 'request_id': 'req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:59.295082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08c4e51da7f4358b60be3af9ef42258', 'request_id': 'req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:59.310459 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] The token cache is being invalidate because project e08c4e51da7f4358b60be3af9ef42258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:59.310865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:59.311685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fea7b2b7-d806-4b66-b377-6b7cf51c3f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:59.320667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1251/2524] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:59 2022] DELETE /identity/v3/projects/e08c4e51da7f4358b60be3af9ef42258 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:59.322386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.323033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.323033 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.344968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:59.346374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:59.442315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1274/2525] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:59.450251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.450726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.450808 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.477504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:59.478623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:59.487884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1252/2526] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:59.492065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.503866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a69a8-65b8-40a0-aa39-44ec5bf082b5 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.509508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.510462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.510966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.511330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.512142 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:59.512536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.514686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.532810 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1275/2527] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:59.533326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.542516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9762f4-d28f-48c4-addc-3deaca3a070d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.548932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.549616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.550127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.550716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.554698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.566299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.632315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1253/2528] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:59 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:59.632984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.649953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6641-b161-4d8f-a84e-c4f00858514b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.723713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.724320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.724675 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.725196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.725775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.727793 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.754519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1276/2529] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:59 2022] POST /identity/v3/users => generated 303 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:59.758716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.769630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0604f-316e-4577-bdbe-19719a9409e6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.775379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.776505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.776877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.777155 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.778824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.780509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.795915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1254/2530] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:59.797005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.810594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6cb0-38ba-47ee-9b95-2136c88a25d9 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.816499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47539775-004f-4c7a-a101-69441f60d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.817150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47539775-004f-4c7a-a101-69441f60d2cc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.817426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47539775-004f-4c7a-a101-69441f60d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.817693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47539775-004f-4c7a-a101-69441f60d2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.818342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47539775-004f-4c7a-a101-69441f60d2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.819950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47539775-004f-4c7a-a101-69441f60d2cc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.834246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1277/2531] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:59.839449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.852266 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6d2e5-d696-49f6-ba70-35d67fae8075 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.858295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.859002 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.859385 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.859584 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] PATH_INFO: `/v3/projects/655a6d102e38475badd2b15aba3ece76/users/7d9881dab8424be4badeed6a84544771/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.876060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655a6d102e38475badd2b15aba3ece76, user_id=7d9881dab8424be4badeed6a84544771, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.878846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.895040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1255/2532] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:59 2022] PUT /identity/v3/projects/655a6d102e38475badd2b15aba3ece76/users/7d9881dab8424be4badeed6a84544771/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:59.901143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad982-918c-4b43-b8dd-795696ee569c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.901606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad982-918c-4b43-b8dd-795696ee569c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.903094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad982-918c-4b43-b8dd-795696ee569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.945923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c2dad982-918c-4b43-b8dd-795696ee569c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:59.947434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c2dad982-918c-4b43-b8dd-795696ee569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:59.992537 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:00.064574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1278/2533] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:00.073274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:00.076188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:00.176698 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257639fa-e0d7-48e9-b104-e3cea5236b86 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:00.181568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:00.182595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:00.182997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:00.183483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:00.198740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:00.201425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:00.212210 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1256/2534] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:00.969435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:00.969996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:00.970174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.029863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] MFA Rules not processed for user `7d9881dab8424be4badeed6a84544771`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:01.031218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:01.147658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1279/2535] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:01.153425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.169891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff456f85-90b0-48d5-b0df-aca4f7c23562 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:01.179607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:01.179607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.179607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.179607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.180157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:01.182107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:01.221256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1257/2536] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:01 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:01.225399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.238414 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb7d2-ef07-42ff-adf8-cfdb9a2310e2 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:01.384050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:01.384525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.384839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.385118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.385782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:01.389109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:01.454874 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1280/2537] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:01 2022] POST /identity/v3/users => generated 308 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:01.458649 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.474602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6313e-6844-4f30-a364-ee0be31aef62 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:01.491565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b12c98-86c1-4770-a274-de51ad6cbf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:01.492604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12c98-86c1-4770-a274-de51ad6cbf22 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.494013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12c98-86c1-4770-a274-de51ad6cbf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.494475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12c98-86c1-4770-a274-de51ad6cbf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.498142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b12c98-86c1-4770-a274-de51ad6cbf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:01.501416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b12c98-86c1-4770-a274-de51ad6cbf22 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:01.556478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1258/2538] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:01.563373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.589732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab664-c343-4cbb-947e-c238c3fe94f5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:01.596367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.596367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.596599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.605448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:01.607123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.607482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.608094 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] PATH_INFO: `/v3/projects/e725492c2d6a4158bdc780f69c513441/users/3067a3dee155440f8ca630a4d89b9add/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.643215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:01.645488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:01.646031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e725492c2d6a4158bdc780f69c513441, user_id=3067a3dee155440f8ca630a4d89b9add, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:01.649768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:01.691534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1281/2539] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:01 2022] PUT /identity/v3/projects/e725492c2d6a4158bdc780f69c513441/users/3067a3dee155440f8ca630a4d89b9add/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:01.693028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.748310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:01.783779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:01.855760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1d4c7-e6db-4e66-9014-2ecba29d7c11 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:01.862476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1259/2540] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:53:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:01.873908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:01.879652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.881640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.882040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.882880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:01.888117 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:01.909982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1282/2541] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:01.911153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.916574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:01.924263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:01.942434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661765f-523e-441f-ade8-bc45ead9e176 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:01.959284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:01.960278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:01.960780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:01.961234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] PATH_INFO: `/v3/projects/e725492c2d6a4158bdc780f69c513441/users/3067a3dee155440f8ca630a4d89b9add/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:01.964443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e725492c2d6a4158bdc780f69c513441, user_id=3067a3dee155440f8ca630a4d89b9add, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:01.972747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:01.989183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1260/2542] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:01 2022] PUT /identity/v3/projects/e725492c2d6a4158bdc780f69c513441/users/3067a3dee155440f8ca630a4d89b9add/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:02.051857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367a4f-f2a4-4747-8afd-185b538a464b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:02.170437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7fb73-a83e-4b28-b484-f2ca0d7f6230 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:02.171056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7fb73-a83e-4b28-b484-f2ca0d7f6230 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:02.171345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7fb73-a83e-4b28-b484-f2ca0d7f6230 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:02.171618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7fb73-a83e-4b28-b484-f2ca0d7f6230 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:02.290432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7fb73-a83e-4b28-b484-f2ca0d7f6230 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:02.292165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7fb73-a83e-4b28-b484-f2ca0d7f6230 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:02.303670 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:02.318907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1283/2543] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:53:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:03.287929 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:03.290509 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:03.497942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:03.498483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:03.498586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:03.540554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952dc3d-8542-4773-8dcf-fd28e4dff78b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:03.548300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:03.549240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:03.549817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:03.550894 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:03.562297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:03.601990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:03.603713 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950111-1244-4e84-aac7-0d856bbba207 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:03.662342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1261/2544] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:03.670629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] MFA Rules not processed for user `3067a3dee155440f8ca630a4d89b9add`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:03.671890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:03.875849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1284/2545] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:06.333813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c119c-2dae-47e8-8b29-ae303fdf470a None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.335015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c119c-2dae-47e8-8b29-ae303fdf470a None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.335501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c119c-2dae-47e8-8b29-ae303fdf470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.399118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-733c119c-2dae-47e8-8b29-ae303fdf470a None None] MFA Rules not processed for user `8a90dbee17d347c5bce28b88715cb88a`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:06.401404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-733c119c-2dae-47e8-8b29-ae303fdf470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.603595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1262/2546] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:06.604800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:06.615305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.844108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923bfd8-333b-4d95-a8f0-12fc7fccbdad None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:06.849643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:06.850484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.850654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.850932 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.852955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.043661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.045318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.067900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1285/2547] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:07.415593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.416445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.416982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.490093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:07.491360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.529975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.538076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1263/2548] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:07.545193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18759-592a-4fe9-a409-ca4bbc9563c4 service glance] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.560778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.561565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.561848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.562114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.591654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.593912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.612187 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.642079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1286/2549] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:53:07.731692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:07.788438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab47f98-3a58-4c94-90b5-45515541b661 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.798740 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.799325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.799606 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.799883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] PATH_INFO: `/v3/users/7d9881dab8424be4badeed6a84544771` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.814493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9881dab8424be4badeed6a84544771)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.828293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.989602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9881dab8424be4badeed6a84544771'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.990293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9881dab8424be4badeed6a84544771'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.999715 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9881dab8424be4badeed6a84544771'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.012107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9881dab8424be4badeed6a84544771'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.012951 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9881dab8424be4badeed6a84544771'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.041500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1264/2550] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:07 2022] DELETE /identity/v3/users/7d9881dab8424be4badeed6a84544771 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:08.528196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.543582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedea4c-f208-4720-952e-55f6cd551992 service swift] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.623685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:08.714266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.718243 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.718531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.718808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] PATH_INFO: `/v3/projects/655a6d102e38475badd2b15aba3ece76` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.720074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655a6d102e38475badd2b15aba3ece76)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.723235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.889873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655a6d102e38475badd2b15aba3ece76', 'request_id': 'req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.916036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655a6d102e38475badd2b15aba3ece76', 'request_id': 'req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.935880 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655a6d102e38475badd2b15aba3ece76', 'request_id': 'req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.975010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] The token cache is being invalidate because project 655a6d102e38475badd2b15aba3ece76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:08.975352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.977626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:08.981213 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1287/2551] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:08 2022] DELETE /identity/v3/projects/655a6d102e38475badd2b15aba3ece76 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:08.985201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.986814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:09.037109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03185-4694-4090-94bc-55e5e52acc92 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:09.070041 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:09.071490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:09.283371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:09.284045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:09.284322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:09.284608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] PATH_INFO: `/v3/users/3067a3dee155440f8ca630a4d89b9add` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:09.295834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3067a3dee155440f8ca630a4d89b9add)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:09.297891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:09.361479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bace22-6e5b-41a6-9a4c-1bd16fcdf089 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:09.378502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:09.379223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:09.379610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:09.380004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:09.398279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:09.437533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:09.440022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:09.470163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3067a3dee155440f8ca630a4d89b9add'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:09.474724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3067a3dee155440f8ca630a4d89b9add'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:09.478026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1288/2552] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:09.514717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3067a3dee155440f8ca630a4d89b9add'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:09.522089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:09.533024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3067a3dee155440f8ca630a4d89b9add'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:09.534000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-5d9e5c87-3b62-4bdd-964b-b5892be20b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3067a3dee155440f8ca630a4d89b9add'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:09.628029 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1265/2553] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:08 2022] DELETE /identity/v3/users/3067a3dee155440f8ca630a4d89b9add => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:10.096434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:10.099230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:10.143674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968572-64b8-43bb-8996-f9534a6e61b3 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:10.234644 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:10.282232 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:10.284214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.284851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.286127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] PATH_INFO: `/v3/projects/e725492c2d6a4158bdc780f69c513441` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.288260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e725492c2d6a4158bdc780f69c513441)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:10.291769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:10.407409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e725492c2d6a4158bdc780f69c513441', 'request_id': 'req-eff84256-cf37-42be-bf2b-8cdffa754577'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:10.416060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e725492c2d6a4158bdc780f69c513441', 'request_id': 'req-eff84256-cf37-42be-bf2b-8cdffa754577'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:10.432362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e725492c2d6a4158bdc780f69c513441', 'request_id': 'req-eff84256-cf37-42be-bf2b-8cdffa754577'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:10.477674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] The token cache is being invalidate because project e725492c2d6a4158bdc780f69c513441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:10.478030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:10.485292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-eff84256-cf37-42be-bf2b-8cdffa754577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:10.495097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.496263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.496263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.498233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1289/2554] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:10 2022] DELETE /identity/v3/projects/e725492c2d6a4158bdc780f69c513441 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:10.567439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:10.568923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:10.714281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1266/2555] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:10.722288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.722567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.722836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.770447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:10.776135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:10.816640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1290/2556] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:10.817885 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:10.842831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2fa4b-0d5d-4fdc-820b-115b0535fbd7 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:10.864130 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:10.867278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.867741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.868588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.873601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:10.875059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:10.881148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:10.937437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1267/2557] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:10.938472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:10.957456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a7a0d-f0f0-4430-926c-bdb36c9cc31c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:10.975113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:10.975311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.975591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.982781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.983032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:10.984984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:11.086024 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1291/2558] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:10 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:11.086382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:11.104988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498d55-e74d-45ba-a32b-147a49fcda0e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:11.309637 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:11.310622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:11.312508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:11.313127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:11.313960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:11.316123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:11.373421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1268/2559] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:11 2022] POST /identity/v3/users => generated 286 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:11.377330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:11.399257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2300339-ffc2-4d50-827d-6f008b9abe67 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:11.424607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:11.425289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:11.425571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:11.425848 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:11.426527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:11.428267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:11.467865 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1292/2560] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:11.468839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:11.485239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec4afe-05d7-4be7-8e90-63760e3b526b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:11.505153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135f11-5a42-479f-a358-7dba44da0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:11.506925 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135f11-5a42-479f-a358-7dba44da0499 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:11.507360 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135f11-5a42-479f-a358-7dba44da0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:11.507787 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135f11-5a42-479f-a358-7dba44da0499 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:11.508611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135f11-5a42-479f-a358-7dba44da0499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:11.510512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135f11-5a42-479f-a358-7dba44da0499 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:11.544117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1269/2561] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:11.545040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:11.555221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7ed2d-ba5b-4178-ad60-9431915caf4c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:11.575362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:11.576118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:11.576393 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:11.576676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] PATH_INFO: `/v3/projects/5f4c3ae988e84a10ba4b0a850b49e6d1/users/ea7e09736d504b57b44bcfb7bfc0cc26/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:11.626934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4c3ae988e84a10ba4b0a850b49e6d1, user_id=ea7e09736d504b57b44bcfb7bfc0cc26, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:11.629734 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:11.670616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1293/2562] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:11 2022] PUT /identity/v3/projects/5f4c3ae988e84a10ba4b0a850b49e6d1/users/ea7e09736d504b57b44bcfb7bfc0cc26/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:11.674507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:11.675111 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:11.675559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:11.758178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] MFA Rules not processed for user `ea7e09736d504b57b44bcfb7bfc0cc26`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:11.759722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:11.854651 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:11.967602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:11.970492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1270/2563] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:12.091266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7dec-901f-4a2f-a7ee-c1e87609fc3a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:12.101337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:12.111058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.111689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.112085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.112953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:12.123473 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:12.153857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:12.192651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1294/2564] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:11 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:12.196897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:12.213093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f604f0-7af0-46de-972c-5df9ea58b356 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:12.357209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:12.358100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.358535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.358978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.361731 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:12.365152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:12.397370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1271/2565] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:12 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:12.397963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:12.428065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d72a7-e227-4c0c-ba02-6cf98e70a8d5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:12.451233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:12.452001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.452318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.452820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.453491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:12.458839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:12.498276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:12.508385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1295/2566] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:12.516430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9f8f-4a7b-410f-9348-dea5987a50b9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:12.529906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:12.532069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.532463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.533072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] PATH_INFO: `/v3/projects/669f90def92c44f5a3b54ecfd15a140a/users/8f300eabe88f448586fe5665eb8f0221/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.580243 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669f90def92c44f5a3b54ecfd15a140a, user_id=8f300eabe88f448586fe5665eb8f0221, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:12.584471 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:12.617085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1272/2567] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:12 2022] PUT /identity/v3/projects/669f90def92c44f5a3b54ecfd15a140a/users/8f300eabe88f448586fe5665eb8f0221/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:12.617306 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:12.633803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bbeb5-bd5d-4eaa-91de-5829667eca4e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:12.846920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803933bb-6257-450f-b670-189b966ca6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:12.847551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803933bb-6257-450f-b670-189b966ca6dd admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.847837 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803933bb-6257-450f-b670-189b966ca6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.848130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803933bb-6257-450f-b670-189b966ca6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.848783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803933bb-6257-450f-b670-189b966ca6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:12.851663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803933bb-6257-450f-b670-189b966ca6dd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:12.883155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1296/2568] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:12.887753 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:12.902674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8dd8-d473-48fe-b932-6b9b0989fae5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:12.926699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:12.928286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.929139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.930041 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] PATH_INFO: `/v3/projects/669f90def92c44f5a3b54ecfd15a140a/users/8f300eabe88f448586fe5665eb8f0221/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.932960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=669f90def92c44f5a3b54ecfd15a140a, user_id=8f300eabe88f448586fe5665eb8f0221, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:12.937172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:12.968343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:12.969211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:12.969859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:12.972825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1273/2569] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:12 2022] PUT /identity/v3/projects/669f90def92c44f5a3b54ecfd15a140a/users/8f300eabe88f448586fe5665eb8f0221/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:13.035919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] MFA Rules not processed for user `8f300eabe88f448586fe5665eb8f0221`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:13.037605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:13.196894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1297/2570] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:13.209554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:13.211281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:13.334924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adaa66-4143-4206-983f-a5d995d8a98a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:13.344370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8a91a-9f69-4bc9-9348-44ec6a092a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:13.351676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a91a-9f69-4bc9-9348-44ec6a092a6d service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:13.352039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a91a-9f69-4bc9-9348-44ec6a092a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:13.352240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8a91a-9f69-4bc9-9348-44ec6a092a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:13.378192 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8a91a-9f69-4bc9-9348-44ec6a092a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:13.380952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8a91a-9f69-4bc9-9348-44ec6a092a6d service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:13.410693 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1274/2571] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:14.212222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:14.340576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b63f6-1194-4086-89a8-d6d42a57abad None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:14.351547 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:14.352866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.353329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.354647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] PATH_INFO: `/v3/users/ea7e09736d504b57b44bcfb7bfc0cc26` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.368336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7e09736d504b57b44bcfb7bfc0cc26)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:14.372371 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:14.381398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:14.492436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7e09736d504b57b44bcfb7bfc0cc26'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.495405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7e09736d504b57b44bcfb7bfc0cc26'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.523412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7e09736d504b57b44bcfb7bfc0cc26'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.524831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7e09736d504b57b44bcfb7bfc0cc26'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.556630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7e09736d504b57b44bcfb7bfc0cc26'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.604173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1298/2572] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:14 2022] DELETE /identity/v3/users/ea7e09736d504b57b44bcfb7bfc0cc26 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:14.606752 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.607310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.607310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.662665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:14.664136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:14.738989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:14.814973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1275/2573] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:14.823437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:14.826030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:14.978942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4ca9-90c7-40d3-baa4-9206ef7f0d3f admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:14.994999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:14.996190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.996468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.996744 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.016966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:15.018669 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:15.039492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1299/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:15.767273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:15.768707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.790712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4a7f0-0dd6-4a93-9680-34b311e89717 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:15.796627 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:15.797972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.798497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.799010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] PATH_INFO: `/v3/projects/5f4c3ae988e84a10ba4b0a850b49e6d1` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.801493 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4c3ae988e84a10ba4b0a850b49e6d1)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:15.803762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:15.895777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4c3ae988e84a10ba4b0a850b49e6d1', 'request_id': 'req-ce930262-38aa-4373-b2bc-e37fb07d6092'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.921569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4c3ae988e84a10ba4b0a850b49e6d1', 'request_id': 'req-ce930262-38aa-4373-b2bc-e37fb07d6092'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.931603 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4c3ae988e84a10ba4b0a850b49e6d1', 'request_id': 'req-ce930262-38aa-4373-b2bc-e37fb07d6092'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.960946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] The token cache is being invalidate because project 5f4c3ae988e84a10ba4b0a850b49e6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:15.961906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.962788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.965497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1276/2575] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:15 2022] DELETE /identity/v3/projects/5f4c3ae988e84a10ba4b0a850b49e6d1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:15.969581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:15.988752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29c8b-bf50-4a39-9b80-a4c02965a4f0 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.110886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.111562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.111857 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.112131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] PATH_INFO: `/v3/users/8f300eabe88f448586fe5665eb8f0221` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.116652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f300eabe88f448586fe5665eb8f0221)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.118672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.185074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:16.222237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f300eabe88f448586fe5665eb8f0221'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.222973 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f300eabe88f448586fe5665eb8f0221'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.237258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f300eabe88f448586fe5665eb8f0221'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.238679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f300eabe88f448586fe5665eb8f0221'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.253214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f300eabe88f448586fe5665eb8f0221'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.310161 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1300/2576] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:15 2022] DELETE /identity/v3/users/8f300eabe88f448586fe5665eb8f0221 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:16.728992 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.730512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.846535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce930262-38aa-4373-b2bc-e37fb07d6092 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.926849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.927496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.927774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.928119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.931812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.962999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:17.059114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:17.060782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:17.084452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cf144-325a-4fae-b1d3-0c6a10723814 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:17.092078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:17.093099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:17.094445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.094647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2910-ccec-489b-a6d7-ffb3fa95b739 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:17.095603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.096565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] PATH_INFO: `/v3/projects/669f90def92c44f5a3b54ecfd15a140a` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.099390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=669f90def92c44f5a3b54ecfd15a140a)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:17.102634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:17.122300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1277/2577] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:17.228976 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669f90def92c44f5a3b54ecfd15a140a', 'request_id': 'req-165ce5ca-f256-4056-b9b1-7d2c78220bed'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:17.246573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669f90def92c44f5a3b54ecfd15a140a', 'request_id': 'req-165ce5ca-f256-4056-b9b1-7d2c78220bed'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:17.266827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669f90def92c44f5a3b54ecfd15a140a', 'request_id': 'req-165ce5ca-f256-4056-b9b1-7d2c78220bed'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:17.296440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] The token cache is being invalidate because project 669f90def92c44f5a3b54ecfd15a140a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:17.297149 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:17.298132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-165ce5ca-f256-4056-b9b1-7d2c78220bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:17.303351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1301/2578] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:17 2022] DELETE /identity/v3/projects/669f90def92c44f5a3b54ecfd15a140a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:17.311682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.312152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.312615 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.378430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:17.385552 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:17.539942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1278/2579] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:17.549323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.550058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.550536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.611362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:17.617423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:17.642233 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1302/2580] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:17.648756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:17.663421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba2995-3d2e-4091-8faa-baa740cb404d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:17.685485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:17.686116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.686449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.686724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.687438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:17.687738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:17.689496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:17.728594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1279/2581] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:17.733217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:17.745270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac20d9-5212-4c89-b7a2-b34bd4d5d28d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:17.764647 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:17.765475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.765757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.766030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.766661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:17.768608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:17.846261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1303/2582] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:17 2022] POST /identity/v3/projects => generated 359 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:17.850553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:17.867711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397418-041c-417d-a54b-d802bf84516b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:17.995756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:17.996846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.997382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.997865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.999337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.002961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:18.050773 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:18.054728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1280/2583] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:17 2022] POST /identity/v3/users => generated 280 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:18.066516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24415e-f8bb-4ecd-9567-2dcff2ae6c81 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:18.088833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:18.090603 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.092368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.092841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.093676 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.101038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:18.127774 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1304/2584] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:18.133163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:18.155794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01ce25-f553-402f-92d4-6a0ad3dd2724 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:18.168022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f47e0-d48b-4b2a-b2fe-eb01e2167f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:18.168770 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f47e0-d48b-4b2a-b2fe-eb01e2167f3f admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.169060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f47e0-d48b-4b2a-b2fe-eb01e2167f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.169337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f47e0-d48b-4b2a-b2fe-eb01e2167f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.169999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f47e0-d48b-4b2a-b2fe-eb01e2167f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.171701 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f47e0-d48b-4b2a-b2fe-eb01e2167f3f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:18.209628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:18.210078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1281/2585] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:18.225106 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c2d26-dadb-4486-8cdc-ebeb32952ae7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:18.246912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:18.247741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.248020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.248290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] PATH_INFO: `/v3/projects/4e892346f1e44853aab6ec51fd2ee099/users/7ccc0ac4538d431c8b2ede49812865c2/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.272757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e892346f1e44853aab6ec51fd2ee099, user_id=7ccc0ac4538d431c8b2ede49812865c2, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.275463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:18.335389 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.335941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.336417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.338355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1305/2586] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:18 2022] PUT /identity/v3/projects/4e892346f1e44853aab6ec51fd2ee099/users/7ccc0ac4538d431c8b2ede49812865c2/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:18.415976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] MFA Rules not processed for user `7ccc0ac4538d431c8b2ede49812865c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:18.417867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:18.441778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:18.552919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1282/2587] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:18.585169 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:18.589665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:18.660889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:18.722719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ec81-44f4-4851-a73f-a7eb2c32d8d2 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:18.730680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0622fe2-d21e-4851-a239-610d92c50225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:18.731438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0622fe2-d21e-4851-a239-610d92c50225 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.731573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0622fe2-d21e-4851-a239-610d92c50225 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.731845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0622fe2-d21e-4851-a239-610d92c50225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.748224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0622fe2-d21e-4851-a239-610d92c50225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.749784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0622fe2-d21e-4851-a239-610d92c50225 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:18.766565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1306/2588] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:18.799959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:18.949832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58969bda-68bd-4f00-bf91-da85198764e1 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:18.956129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:18.956813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.957629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.957629 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] PATH_INFO: `/v3/users/7ccc0ac4538d431c8b2ede49812865c2` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.958726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ccc0ac4538d431c8b2ede49812865c2)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.961003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:19.072946 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ccc0ac4538d431c8b2ede49812865c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:19.074159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ccc0ac4538d431c8b2ede49812865c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:19.082271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ccc0ac4538d431c8b2ede49812865c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:19.095000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ccc0ac4538d431c8b2ede49812865c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:19.095806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ccc0ac4538d431c8b2ede49812865c2'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:19.169455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1283/2589] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:18 2022] DELETE /identity/v3/users/7ccc0ac4538d431c8b2ede49812865c2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:19.171519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616405-775f-404e-b4fa-00a664720388 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:19.172302 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616405-775f-404e-b4fa-00a664720388 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:19.172751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43616405-775f-404e-b4fa-00a664720388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:19.210650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-43616405-775f-404e-b4fa-00a664720388 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:19.211660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-43616405-775f-404e-b4fa-00a664720388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:19.362333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1307/2590] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:19.382938 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:19.384392 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:19.470937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:19.546274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19475658-3e34-4bf2-bc03-9c4abf1c2d45 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:19.555733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2f8d-79b2-4a0c-b077-f2d761b651ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:19.556535 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2f8d-79b2-4a0c-b077-f2d761b651ff service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:19.556958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2f8d-79b2-4a0c-b077-f2d761b651ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:19.557338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2f8d-79b2-4a0c-b077-f2d761b651ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:19.582939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2f8d-79b2-4a0c-b077-f2d761b651ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:19.585163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2f8d-79b2-4a0c-b077-f2d761b651ff service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:19.601965 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1284/2591] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:20.285280 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43616405-775f-404e-b4fa-00a664720388 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:20.286805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-43616405-775f-404e-b4fa-00a664720388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:20.329060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43616405-775f-404e-b4fa-00a664720388 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:20.342157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:20.343139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.345190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.345599 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] PATH_INFO: `/v3/projects/4e892346f1e44853aab6ec51fd2ee099` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.347183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e892346f1e44853aab6ec51fd2ee099)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:20.352241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:20.479416 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e892346f1e44853aab6ec51fd2ee099', 'request_id': 'req-26ac16ff-b0a4-433a-9f12-1018b9215621'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:20.492452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e892346f1e44853aab6ec51fd2ee099', 'request_id': 'req-26ac16ff-b0a4-433a-9f12-1018b9215621'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:20.513419 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e892346f1e44853aab6ec51fd2ee099', 'request_id': 'req-26ac16ff-b0a4-433a-9f12-1018b9215621'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:20.538902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] The token cache is being invalidate because project 4e892346f1e44853aab6ec51fd2ee099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:20.539896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:20.543279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-26ac16ff-b0a4-433a-9f12-1018b9215621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:20.544911 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1308/2592] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:20 2022] DELETE /identity/v3/projects/4e892346f1e44853aab6ec51fd2ee099 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:20.550280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.551086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.551540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.600988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:20.603923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:20.727297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1285/2593] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:20.736438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.736843 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.737194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.773651 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:20.774887 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:20.801862 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1309/2594] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:20.803442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:20.825442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c65e5b-d54a-481f-a73b-e94e4fcceb2e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:20.834456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:20.835140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.835431 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.835786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.836460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:20.836896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:20.838726 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:20.857295 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1286/2595] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:20.861488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:20.873951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954e2f9-bb61-4fac-b636-ec995087e108 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:20.879719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:20.880336 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.880616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.880918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.881555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:20.883468 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:20.930405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1310/2596] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:20 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:20.936003 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:20.950896 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3df76-2339-4fbd-b548-c80ebff89676 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.038230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.039148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.040065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.040521 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.043958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.047971 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.140479 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1287/2597] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:20 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:21.143917 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.167182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4e43-6aa8-411f-a610-84dc4f2a0c42 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.179721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.180363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.180654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.180942 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.181610 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.183596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.208616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1311/2598] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:21.212456 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.232486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568eb64-1da3-42dd-bbaa-611a64323662 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.245959 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429277f3-26a3-4807-bc52-47e51aa8b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.246794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429277f3-26a3-4807-bc52-47e51aa8b0ff admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.247075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429277f3-26a3-4807-bc52-47e51aa8b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.247351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429277f3-26a3-4807-bc52-47e51aa8b0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.248019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429277f3-26a3-4807-bc52-47e51aa8b0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.249692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429277f3-26a3-4807-bc52-47e51aa8b0ff admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.302933 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1288/2599] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:21.304537 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.321796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11781c92-741f-4afe-99bd-cc74192821df admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.333746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.335018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.337400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.337820 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] PATH_INFO: `/v3/projects/945b8929ee674965b723296ca9e5f5dc/users/1debf3c8a9964e469285baa2b9504485/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.366093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:21.377434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] RBAC: Authorizing `identity:create_grant(project_id=945b8929ee674965b723296ca9e5f5dc, user_id=1debf3c8a9964e469285baa2b9504485, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.379543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.416174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1312/2600] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:21 2022] PUT /identity/v3/projects/945b8929ee674965b723296ca9e5f5dc/users/1debf3c8a9964e469285baa2b9504485/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:21.420762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.420762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.420762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.462545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] MFA Rules not processed for user `1debf3c8a9964e469285baa2b9504485`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:21.463855 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.483265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.485983 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.526265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:21.598867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c339f1-b6bd-44be-815e-85b88c1f087c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.602400 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1289/2601] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:21.610846 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.614601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.617006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.618237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.618750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.622731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.636343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.638784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.676376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1313/2602] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:21.819834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa424345-ba21-4c6e-9943-c273b2b9e72d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.829091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.829758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.830040 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.830310 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.830961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.833448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.888735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1290/2603] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:21 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:21.893574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.925064 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e97b88-efb6-4399-8763-820bfd56993f service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.079266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.079895 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.080182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.080449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.086488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.088602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.135231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1314/2604] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:21 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:22.138958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.159923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0973-2058-4b52-882a-23c8e4277350 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.181983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.183072 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.183394 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.183742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.185048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.188326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.207045 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1291/2605] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:22.210872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.229032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eac44-457f-42b5-9bb0-c52fe1e425fc admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.247078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58be3e-8b1e-483c-8479-0459345f352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.247799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58be3e-8b1e-483c-8479-0459345f352e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.248155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58be3e-8b1e-483c-8479-0459345f352e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.248497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58be3e-8b1e-483c-8479-0459345f352e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.249386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58be3e-8b1e-483c-8479-0459345f352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.263711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58be3e-8b1e-483c-8479-0459345f352e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.302907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1315/2606] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:22.304947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.319650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefcb15-6610-498a-b255-86f98446825c admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.337183 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.337445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.337734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.338081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] PATH_INFO: `/v3/projects/060b87ae36a844b3b7121ac67a94780d/users/a7ff01ce997249df97c570e821c22513/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.373228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=060b87ae36a844b3b7121ac67a94780d, user_id=a7ff01ce997249df97c570e821c22513, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.375932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.413291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1292/2607] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:22 2022] PUT /identity/v3/projects/060b87ae36a844b3b7121ac67a94780d/users/a7ff01ce997249df97c570e821c22513/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:22.419118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.420216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.420555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.461009 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] MFA Rules not processed for user `a7ff01ce997249df97c570e821c22513`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:22.462805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:22.582379 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:22.610470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.611184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1316/2608] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:22.762349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1a3db-609d-4ab9-b512-8856461cdb2a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.770382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.771030 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.771327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.771586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.772761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.775177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.855488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1293/2609] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:22 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:22.859453 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.899017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce1105-a41a-41a6-8015-902eef218d1b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.075403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.076189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.076691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.076968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.077641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.079718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.135101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.135519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1317/2610] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:22 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:23.143811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:23.147859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec230e-623c-48d2-9c41-eb9d1a34bed0 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.188342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.189199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.189489 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.189766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.190442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.192114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.238419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1294/2611] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:23.239699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.257270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009508de-0098-45c4-8906-9dfc23533965 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.265135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.266171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.266722 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.267092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] PATH_INFO: `/v3/projects/8de7fc49226f4d8a8aa49efdb194da95/users/74f22e3ed37743aba8d135fb0fdf1b13/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.303143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de7fc49226f4d8a8aa49efdb194da95, user_id=74f22e3ed37743aba8d135fb0fdf1b13, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.313873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.338010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1318/2612] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:23 2022] PUT /identity/v3/projects/8de7fc49226f4d8a8aa49efdb194da95/users/74f22e3ed37743aba8d135fb0fdf1b13/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:23.342439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.357462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3a547-2c49-4875-a4e6-d3b3aed41f92 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.458724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca1993-87cf-49b8-b05e-f6247f1d50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.459664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca1993-87cf-49b8-b05e-f6247f1d50f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.460104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca1993-87cf-49b8-b05e-f6247f1d50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.460531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca1993-87cf-49b8-b05e-f6247f1d50f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.461401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca1993-87cf-49b8-b05e-f6247f1d50f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.463517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca1993-87cf-49b8-b05e-f6247f1d50f9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.487098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1295/2613] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:23.492263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.507574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b97e3-8871-4711-ab75-920be7a028cd admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.516176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.518022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.518369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.518740 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] PATH_INFO: `/v3/projects/8de7fc49226f4d8a8aa49efdb194da95/users/74f22e3ed37743aba8d135fb0fdf1b13/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.525892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de7fc49226f4d8a8aa49efdb194da95, user_id=74f22e3ed37743aba8d135fb0fdf1b13, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.530068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.556231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1319/2614] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:23 2022] PUT /identity/v3/projects/8de7fc49226f4d8a8aa49efdb194da95/users/74f22e3ed37743aba8d135fb0fdf1b13/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:23.559178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.559720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.560147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.610738 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] MFA Rules not processed for user `74f22e3ed37743aba8d135fb0fdf1b13`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:23.613650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:23.799407 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.807241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:23.837334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1296/2615] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:23.873113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.875398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.048591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a898d3-7365-493c-be94-22b048b5e227 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.054663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.055469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.055837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.056208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.097771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba930c79-72a6-45dd-bdcd-2f7fbd175c28 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.123800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.124516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.125010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.125304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] PATH_INFO: `/v3/users/f6f4f7ec5b174efb88287c751bd69365` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.126873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f4f7ec5b174efb88287c751bd69365)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.131938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.136334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:24.230377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.230377 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.261206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1297/2616] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:24.390858 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f4f7ec5b174efb88287c751bd69365'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.391003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f4f7ec5b174efb88287c751bd69365'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.400332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:24.410556 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f4f7ec5b174efb88287c751bd69365'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.411566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f4f7ec5b174efb88287c751bd69365'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.433271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-e76cbab1-f5a5-472d-9b12-f598b4fd6bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f4f7ec5b174efb88287c751bd69365'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.465555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1320/2617] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:23 2022] DELETE /identity/v3/users/f6f4f7ec5b174efb88287c751bd69365 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:24.774857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.797150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b31e14-0e41-4834-a20d-23fb2a824987 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.995398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.995398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.997327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.998205 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] PATH_INFO: `/v3/projects/dd062ec6cfca4743b65fb0b98c6f3d6b` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.000927 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd062ec6cfca4743b65fb0b98c6f3d6b)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.005250 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.086816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd062ec6cfca4743b65fb0b98c6f3d6b', 'request_id': 'req-4ac0e7f9-fa26-465f-990f-87c81d6c9732'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.099052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd062ec6cfca4743b65fb0b98c6f3d6b', 'request_id': 'req-4ac0e7f9-fa26-465f-990f-87c81d6c9732'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.108237 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd062ec6cfca4743b65fb0b98c6f3d6b', 'request_id': 'req-4ac0e7f9-fa26-465f-990f-87c81d6c9732'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.134793 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] The token cache is being invalidate because project dd062ec6cfca4743b65fb0b98c6f3d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:25.135095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.136038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4ac0e7f9-fa26-465f-990f-87c81d6c9732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.138027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1298/2618] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:24 2022] DELETE /identity/v3/projects/dd062ec6cfca4743b65fb0b98c6f3d6b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:25.143099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.144013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.144459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.187511 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:25.189164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.289618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1321/2619] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:25.298569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.299962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.300574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.342644 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:25.346209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.361409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1299/2620] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:25.366167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.388390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f548-757b-496b-ac4b-6bc4e95555fc None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.394257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.395026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.395185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.395431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.396104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:25.396492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.398091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ceca-215c-4758-8049-c7abc46bac95 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.415590 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1322/2621] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:25.416734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.430244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a97a-f583-4bfc-a71d-bc1c3251bfd3 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.441999 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.443165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.443712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.444052 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.444856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.446842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.447328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.447804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.450707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.470629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] MFA Rules not processed for user `19caf7c7cc1b4c74a4e5b73e61a2bf07`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:25.472223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.487728 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1300/2622] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:25.491919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.529426 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:25.547952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1323/2623] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:25.570270 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9962e15-9de4-44b9-9be5-dd5131d4dd98 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.575598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.576217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.576495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.576802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.577461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.579836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.606689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1301/2624] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:25.610799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.623289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f727b-c90c-4e5e-8de5-eedd1b23403a None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.628838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.629586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.630056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.630443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.631251 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.633044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.646332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1324/2625] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:25.650924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.664524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47e24-53ff-4c5e-834b-a7922dc1acd2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.670017 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f6261-befc-4b2d-aa21-34e6e8e6e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.670915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6261-befc-4b2d-aa21-34e6e8e6e404 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.671296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6261-befc-4b2d-aa21-34e6e8e6e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.671668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f6261-befc-4b2d-aa21-34e6e8e6e404 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.672427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f6261-befc-4b2d-aa21-34e6e8e6e404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.674193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f6261-befc-4b2d-aa21-34e6e8e6e404 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.690293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1302/2626] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:25.694284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.715138 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd98799-e495-45df-913b-65ad64572eb4 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.722431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.723325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.723748 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.724131 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] PATH_INFO: `/v3/projects/75763923f7384e6397f3252e17f0ea5f/users/f73d2f95010f4115905e77dfa9dff352/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.758470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75763923f7384e6397f3252e17f0ea5f, user_id=f73d2f95010f4115905e77dfa9dff352, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.761836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.782049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1325/2627] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:25 2022] PUT /identity/v3/projects/75763923f7384e6397f3252e17f0ea5f/users/f73d2f95010f4115905e77dfa9dff352/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:25.792829 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.794007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.794468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.829341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] MFA Rules not processed for user `f73d2f95010f4115905e77dfa9dff352`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:25.830762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.896654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.898894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.914604 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1303/2628] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:25.926888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.929032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.942899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:25.981700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35b86-92b6-40e6-812b-37109f5ff4d3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.985627 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.987091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.987512 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.988498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.993429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.005731 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:26.007523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:26.019303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1326/2629] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:26.055745 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bee2-00cf-495b-8d9a-f983c17ec0c6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:26.064567 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:26.065263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.065546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.065816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.077512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:26.079328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:26.095365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1304/2630] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:26.315012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:26.316528 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.387825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec201aad-42cc-4aee-8483-f617781dbc00 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:26.391979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:26.392623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.392930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.393201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.395099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.462311 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:26.465969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.523065 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:26.524115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:26.530833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:26.551593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1327/2631] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:26.592007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b1f09-8738-4bc2-820b-39b96b37e52f service nova] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:26.598968 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:26.600293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.600798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.601433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.604378 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.618842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:26.620659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a673b-fd5f-4d66-b1b1-51b2e17b9ef6 service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:26.646985 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1305/2632] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:26.775438 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:26.835923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466144-3fe8-43ae-bfc1-4300afe0ba31 None None] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.836487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466144-3fe8-43ae-bfc1-4300afe0ba31 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.836487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466144-3fe8-43ae-bfc1-4300afe0ba31 None None] PATH_INFO: `/` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.839446 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1306/2633] 10.222.0.45 () {54 vars in 921 bytes} [Tue Oct 4 08:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:53:26.845742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.846101 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.846860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.878683 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] MFA Rules not processed for user `464a6f0e27d642efb036de9164eeefc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:26.882501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.899942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1307/2634] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Oct 4 08:53:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:26.904867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbdf73-4e4b-4e62-ac1c-ac5c92e510dc service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:26.910391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:26.911121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.911396 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.911673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] PATH_INFO: `/v3/users/f73d2f95010f4115905e77dfa9dff352` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.913226 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73d2f95010f4115905e77dfa9dff352)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:26.915575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:26.917172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.925791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:26.986724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:27.030722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22649ce3-e8aa-4a66-b33e-6a1fc3c1aa39 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:27.034812 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad4c57-02f7-4f69-a8bd-ee0fe8795beb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:27.034990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73d2f95010f4115905e77dfa9dff352'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.035633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad4c57-02f7-4f69-a8bd-ee0fe8795beb service glance] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.035753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73d2f95010f4115905e77dfa9dff352'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.035993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad4c57-02f7-4f69-a8bd-ee0fe8795beb service glance] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.036338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad4c57-02f7-4f69-a8bd-ee0fe8795beb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.063830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad4c57-02f7-4f69-a8bd-ee0fe8795beb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:27.065766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad4c57-02f7-4f69-a8bd-ee0fe8795beb service glance] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.066133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73d2f95010f4115905e77dfa9dff352'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.066881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73d2f95010f4115905e77dfa9dff352'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.078398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73d2f95010f4115905e77dfa9dff352'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.086329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1308/2635] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:27.119101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1328/2636] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:26 2022] DELETE /identity/v3/users/f73d2f95010f4115905e77dfa9dff352 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:27.125563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.125934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.126800 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.159214 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:27.160877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.278024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1309/2637] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:27.290299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:27.292367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.394966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797ebf6-e326-4683-ab60-94e8daa01a4c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:27.401633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:27.402262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.402539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.402825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.427075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:27.428940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.450656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1329/2638] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:27.508518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:27.510048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.613602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfdb77-6974-4f7f-8dc1-37c8d9b3d82e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:27.618569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:27.620941 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.621244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.621571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.624585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.634304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:27.761490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:27.766587 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ce2c7-28ac-4349-ae35-68a50aad21ab service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.784924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1310/2639] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:27.882954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:27.884502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.907608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755477cb-8830-4301-accc-8ea9d1a99e08 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:27.914053 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:27.914892 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.915159 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.915432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] PATH_INFO: `/v3/projects/75763923f7384e6397f3252e17f0ea5f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.916649 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75763923f7384e6397f3252e17f0ea5f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:27.919395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.988202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75763923f7384e6397f3252e17f0ea5f', 'request_id': 'req-23453968-5d5c-4b74-9733-ba677d23ced9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:28.001212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75763923f7384e6397f3252e17f0ea5f', 'request_id': 'req-23453968-5d5c-4b74-9733-ba677d23ced9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:28.012167 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75763923f7384e6397f3252e17f0ea5f', 'request_id': 'req-23453968-5d5c-4b74-9733-ba677d23ced9'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:28.034567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] The token cache is being invalidate because project 75763923f7384e6397f3252e17f0ea5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:28.035374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:28.036591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-23453968-5d5c-4b74-9733-ba677d23ced9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:28.039846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1330/2640] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:27 2022] DELETE /identity/v3/projects/75763923f7384e6397f3252e17f0ea5f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:28.046245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.046819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.047209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.077811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:28.079623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.166271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1311/2641] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:28.182445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.183838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.184124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.207637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:28.209281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.219581 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1331/2642] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:28.224438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.235616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9ab3-49e5-4617-bdd3-256ae2e41e17 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.241100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.241870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.242247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.243742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.246042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:28.246042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.247575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.270043 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1312/2643] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:28.271109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.284578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed82e3-8e62-469f-b87a-289f89a3408c None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.292827 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.293554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.293914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.294261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.295039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.297362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.326654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:28.342561 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.347951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1332/2644] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:28.353308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c16f-5cee-4c36-9c97-e20def85e96f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.436263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87416491-a24e-4247-8029-a270e0dd0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.436947 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87416491-a24e-4247-8029-a270e0dd0a28 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.437232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87416491-a24e-4247-8029-a270e0dd0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.437507 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87416491-a24e-4247-8029-a270e0dd0a28 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.438164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87416491-a24e-4247-8029-a270e0dd0a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.440961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87416491-a24e-4247-8029-a270e0dd0a28 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.473143 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1313/2645] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:28.476237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.480104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.480396 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.480680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.489984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3c039-fdf3-45f8-9ca6-44b81766a575 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.497073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.498032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.498518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.498993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.499869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.501854 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.515217 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:28.516463 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.518507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1333/2646] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:28.519516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.531567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02bbfb-c181-4911-a49e-29713b08b49e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.535354 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:28.538595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.539400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.539690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.539877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.540573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.542461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.557178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1334/2647] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:28.563267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.577074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda47ac-0e03-4872-853f-43e1e81560a5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.583930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed72a18-53f1-4ed9-94a6-04ac4c475d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.585476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72a18-53f1-4ed9-94a6-04ac4c475d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.586050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72a18-53f1-4ed9-94a6-04ac4c475d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.586784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72a18-53f1-4ed9-94a6-04ac4c475d54 admin admin] PATH_INFO: `/v3/projects/d4b44e57406440199998ccaa3aecf376/users/4344175bf7704348b098690f5937cedc/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.607406 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1314/2648] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:28.612028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed72a18-53f1-4ed9-94a6-04ac4c475d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b44e57406440199998ccaa3aecf376, user_id=4344175bf7704348b098690f5937cedc, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.615025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed72a18-53f1-4ed9-94a6-04ac4c475d54 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.624201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.626199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.640401 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1335/2649] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:28 2022] PUT /identity/v3/projects/d4b44e57406440199998ccaa3aecf376/users/4344175bf7704348b098690f5937cedc/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:28.653255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.653523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.653790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.690020 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] MFA Rules not processed for user `4344175bf7704348b098690f5937cedc`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:28.691693 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.720691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fb9fe-54ab-46dd-af7d-15d9c5e3cf18 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.802293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1336/2650] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:28.804953 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.832064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.833254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.833837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.834119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.912097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.913934 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.934874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1315/2651] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:53:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:53:29.006368 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378746-6043-4c3d-8936-e95a1c9b3599 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.023762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.024305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.024661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.025025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.025620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.028157 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.097273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1337/2652] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:28 2022] POST /identity/v3/projects => generated 369 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:29.098047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.112085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3e817-d6a8-4554-88f3-059c834eb3d1 service swift] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.122772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:29.270982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.277056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.277434 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.277816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.278577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.280837 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.350004 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1316/2653] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:29.352584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.368255 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c86b7-294a-4db3-a12a-ace845af572d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.387124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.388055 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.388845 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.389278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.390245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.394315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.453329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.457070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1338/2654] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:29.473729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc649777-bc31-47c2-bd67-4f1178b01108 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.503388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.504233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.504519 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.505157 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] PATH_INFO: `/v3/projects/7b3a60ed5f1c4c85a241ad148dde8d64/users/814374a43a85484e8e4095c5893dcfa8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.572398 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3a60ed5f1c4c85a241ad148dde8d64, user_id=814374a43a85484e8e4095c5893dcfa8, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.581967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.619261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1317/2655] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:29 2022] PUT /identity/v3/projects/7b3a60ed5f1c4c85a241ad148dde8d64/users/814374a43a85484e8e4095c5893dcfa8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:29.625400 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.639443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c68913-0e31-47c7-9aaa-54296ae5c184 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.669204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:29.795285 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e944-29f4-4b39-9de6-dfa33780fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.796078 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e944-29f4-4b39-9de6-dfa33780fa87 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.796505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e944-29f4-4b39-9de6-dfa33780fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.796505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e944-29f4-4b39-9de6-dfa33780fa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.797293 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e944-29f4-4b39-9de6-dfa33780fa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.799235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e944-29f4-4b39-9de6-dfa33780fa87 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.826179 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1339/2656] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:29.830381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.846699 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2148-0693-4783-b136-04c4166c844e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.862197 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.863448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.863936 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.864482 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] PATH_INFO: `/v3/projects/7b3a60ed5f1c4c85a241ad148dde8d64/users/814374a43a85484e8e4095c5893dcfa8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.870861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3a60ed5f1c4c85a241ad148dde8d64, user_id=814374a43a85484e8e4095c5893dcfa8, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.873994 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.899207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1318/2657] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:29 2022] PUT /identity/v3/projects/7b3a60ed5f1c4c85a241ad148dde8d64/users/814374a43a85484e8e4095c5893dcfa8/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:29.915217 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.916017 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.916501 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.983174 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] MFA Rules not processed for user `814374a43a85484e8e4095c5893dcfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:29.987270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.206947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1340/2658] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:30.224641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.226593 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.384227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5449b33-bdda-4ef7-82eb-5d1a8d36b1fa admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.390881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.391819 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.392376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.392779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.408025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.410478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.427013 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1319/2659] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:30.507273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.509660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.540598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e328b-82ed-4728-8fda-31d52bad15de None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.546584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef60cd-e87c-4b9a-a676-827a963165c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.552435 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef60cd-e87c-4b9a-a676-827a963165c6 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.552835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef60cd-e87c-4b9a-a676-827a963165c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.553183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef60cd-e87c-4b9a-a676-827a963165c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.721214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef60cd-e87c-4b9a-a676-827a963165c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.724100 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef60cd-e87c-4b9a-a676-827a963165c6 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.765480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1341/2660] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:32.522452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.524001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.704055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639cf13-0cc1-4a17-8b0e-ffd955bf0e92 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.725036 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.725707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.726066 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.726347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] PATH_INFO: `/v3/users/1debf3c8a9964e469285baa2b9504485` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.730469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1debf3c8a9964e469285baa2b9504485)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.733730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.751019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:32.853545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1debf3c8a9964e469285baa2b9504485'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.854660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1debf3c8a9964e469285baa2b9504485'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.868492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1debf3c8a9964e469285baa2b9504485'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.882571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1debf3c8a9964e469285baa2b9504485'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.883716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1debf3c8a9964e469285baa2b9504485'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.933242 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1320/2661] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:32 2022] DELETE /identity/v3/users/1debf3c8a9964e469285baa2b9504485 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:32.937890 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.939578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.940030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.993459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:32.997228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:33.089882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:33.157574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1342/2662] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:33.168780 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:33.170667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:33.317410 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7acd-4c4b-4cc5-af2a-d53a313e444e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:33.328186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:33.329233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:33.329676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:33.330160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:33.347814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:33.352371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:33.378744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1321/2663] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:33.927382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:33.932104 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:33.995660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8827af-5eb2-466a-b577-1799eba44ec0 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.014640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.015584 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.016303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.017016 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] PATH_INFO: `/v3/projects/945b8929ee674965b723296ca9e5f5dc` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.029449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945b8929ee674965b723296ca9e5f5dc)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.031503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.126079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945b8929ee674965b723296ca9e5f5dc', 'request_id': 'req-75580d51-6952-400a-a19c-71c4d3948ef3'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.133579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945b8929ee674965b723296ca9e5f5dc', 'request_id': 'req-75580d51-6952-400a-a19c-71c4d3948ef3'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.143691 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945b8929ee674965b723296ca9e5f5dc', 'request_id': 'req-75580d51-6952-400a-a19c-71c4d3948ef3'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.165039 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] The token cache is being invalidate because project 945b8929ee674965b723296ca9e5f5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:34.166080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.167980 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.175330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1343/2664] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:33 2022] DELETE /identity/v3/projects/945b8929ee674965b723296ca9e5f5dc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:34.179605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.191470 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202de08-8efd-4a61-b699-fb574b675cf1 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.281128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.282401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.282870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.283341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] PATH_INFO: `/v3/users/a7ff01ce997249df97c570e821c22513` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.286573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ff01ce997249df97c570e821c22513)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.291190 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.354843 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:34.442851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ff01ce997249df97c570e821c22513'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.449490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ff01ce997249df97c570e821c22513'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.481182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ff01ce997249df97c570e821c22513'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.498089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ff01ce997249df97c570e821c22513'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.500252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ff01ce997249df97c570e821c22513'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.551069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1322/2665] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:34 2022] DELETE /identity/v3/users/a7ff01ce997249df97c570e821c22513 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:35.168202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.171997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:35.234087 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75580d51-6952-400a-a19c-71c4d3948ef3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.542148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.543284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.544001 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.544630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] PATH_INFO: `/v3/projects/060b87ae36a844b3b7121ac67a94780d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.546988 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] RBAC: Authorizing `identity:delete_project(project_id=060b87ae36a844b3b7121ac67a94780d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.551195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.687490 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.692267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:35.735606 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060b87ae36a844b3b7121ac67a94780d', 'request_id': 'req-f7fe273b-b7fa-45e3-b694-b6acb02862be'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:35.745172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b9bce-6ec8-40a8-a68b-5a7836c62cf8 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.766478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060b87ae36a844b3b7121ac67a94780d', 'request_id': 'req-f7fe273b-b7fa-45e3-b694-b6acb02862be'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:35.808821 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060b87ae36a844b3b7121ac67a94780d', 'request_id': 'req-f7fe273b-b7fa-45e3-b694-b6acb02862be'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:35.813418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:35.841585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] The token cache is being invalidate because project 060b87ae36a844b3b7121ac67a94780d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:35.842089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:35.849533 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:35.852552 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1344/2666] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:35 2022] DELETE /identity/v3/projects/060b87ae36a844b3b7121ac67a94780d => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:35.858851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.863563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:35.951182 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.953096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.953096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.953795 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] PATH_INFO: `/v3/users/4344175bf7704348b098690f5937cedc` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.956825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4344175bf7704348b098690f5937cedc)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.961932 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.051037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe273b-b7fa-45e3-b694-b6acb02862be admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.062735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.063799 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.064261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.064783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] PATH_INFO: `/v3/users/74f22e3ed37743aba8d135fb0fdf1b13` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.067260 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f22e3ed37743aba8d135fb0fdf1b13)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.071586 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.091106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4344175bf7704348b098690f5937cedc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.092407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4344175bf7704348b098690f5937cedc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.123324 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4344175bf7704348b098690f5937cedc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.139526 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4344175bf7704348b098690f5937cedc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.140645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d20f2401-3f30-494e-b07a-08f083938de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4344175bf7704348b098690f5937cedc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.199365 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f22e3ed37743aba8d135fb0fdf1b13'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.200975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f22e3ed37743aba8d135fb0fdf1b13'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.216376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1323/2667] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:35 2022] DELETE /identity/v3/users/4344175bf7704348b098690f5937cedc => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:36.222469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.222974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.223499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.230256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f22e3ed37743aba8d135fb0fdf1b13'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.231808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f22e3ed37743aba8d135fb0fdf1b13'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.262996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f22e3ed37743aba8d135fb0fdf1b13'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.263595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:36.266322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.308657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:36.340148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1345/2668] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:35 2022] DELETE /identity/v3/users/74f22e3ed37743aba8d135fb0fdf1b13 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:36.450548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1324/2669] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:36.468592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.470987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.649406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd236e74-e52b-4c31-9c14-b3a8ed8d944b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.661029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd1233-17a0-473b-b7b6-32e4a981e8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.662782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd1233-17a0-473b-b7b6-32e4a981e8fe service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.664211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd1233-17a0-473b-b7b6-32e4a981e8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.665099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd1233-17a0-473b-b7b6-32e4a981e8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.753549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:36.857646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd1233-17a0-473b-b7b6-32e4a981e8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.860625 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd1233-17a0-473b-b7b6-32e4a981e8fe service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.881201 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1346/2670] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:37.034123 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.036639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.134263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9e28-e70d-4f49-a682-0efeaffab80a None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.136305 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9e28-e70d-4f49-a682-0efeaffab80a None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.137025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9e28-e70d-4f49-a682-0efeaffab80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.145232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b987ba-e877-4587-b4f3-258b93d1781d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.184254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.187589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.187986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.188240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] PATH_INFO: `/v3/projects/8de7fc49226f4d8a8aa49efdb194da95` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.189904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-905b9e28-e70d-4f49-a682-0efeaffab80a None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:37.192089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de7fc49226f4d8a8aa49efdb194da95)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.194148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.200324 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-905b9e28-e70d-4f49-a682-0efeaffab80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.358056 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de7fc49226f4d8a8aa49efdb194da95', 'request_id': 'req-d3748069-339b-4382-a908-1c18ec75911a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:37.379159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de7fc49226f4d8a8aa49efdb194da95', 'request_id': 'req-d3748069-339b-4382-a908-1c18ec75911a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:37.406088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de7fc49226f4d8a8aa49efdb194da95', 'request_id': 'req-d3748069-339b-4382-a908-1c18ec75911a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:37.431030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1347/2671] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:37.438196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] The token cache is being invalidate because project 8de7fc49226f4d8a8aa49efdb194da95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:37.438528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:37.441536 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:37.444550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1325/2672] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:37 2022] DELETE /identity/v3/projects/8de7fc49226f4d8a8aa49efdb194da95 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:37.452355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a5f2e-b287-417b-8948-bb6328ba1dc2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.452640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a5f2e-b287-417b-8948-bb6328ba1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.453031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a5f2e-b287-417b-8948-bb6328ba1dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.467850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.470331 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.541640 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-651a5f2e-b287-417b-8948-bb6328ba1dc2 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:37.547483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-651a5f2e-b287-417b-8948-bb6328ba1dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.788175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3748069-339b-4382-a908-1c18ec75911a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.806616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.807574 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.808299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.809015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.814401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.824924 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1348/2673] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:37.843700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.845198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.845804 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.891985 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:37.895177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.907618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1349/2674] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:37.913856 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.939110 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adb9f5-6814-40c5-901e-05965afe1821 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.947271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.948115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.948387 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.948933 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.950240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:37.950657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.954455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.989121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1350/2675] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:37.989121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.993685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.996888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:38.010394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867447e-d6ea-402e-8b56-2372dcd711db admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.016204 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.017079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.017456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.017824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] PATH_INFO: `/v3/projects/d4b44e57406440199998ccaa3aecf376` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.019543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b44e57406440199998ccaa3aecf376)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.021674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.068758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.072201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.097547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1326/2676] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:38.099057 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.099576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:38.130323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b44e57406440199998ccaa3aecf376', 'request_id': 'req-fa8d64a6-5194-41e0-99a2-22999dc83d04'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.151383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccffb8-7ef4-45ff-a8c3-d81de6b56dfd service swift] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.155499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b44e57406440199998ccaa3aecf376', 'request_id': 'req-fa8d64a6-5194-41e0-99a2-22999dc83d04'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.169784 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b44e57406440199998ccaa3aecf376', 'request_id': 'req-fa8d64a6-5194-41e0-99a2-22999dc83d04'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.191569 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] The token cache is being invalidate because project d4b44e57406440199998ccaa3aecf376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:38.203443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.204560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.210299 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1351/2677] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:37 2022] DELETE /identity/v3/projects/d4b44e57406440199998ccaa3aecf376 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:38.216199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.219846 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.328680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.329380 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.329591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.329889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.330735 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.339265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.460150 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1327/2678] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/projects => generated 367 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:38.469256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d64a6-5194-41e0-99a2-22999dc83d04 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.471711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.487623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.615813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.617444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.618783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.620240 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] PATH_INFO: `/v3/users/814374a43a85484e8e4095c5893dcfa8` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.636521 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814374a43a85484e8e4095c5893dcfa8)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.639551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.740135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e14c4-38c5-47c6-8865-4e648b152025 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.756409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.758032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.759085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.760676 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.762598 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.766747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.774818 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814374a43a85484e8e4095c5893dcfa8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.776622 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814374a43a85484e8e4095c5893dcfa8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.806008 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814374a43a85484e8e4095c5893dcfa8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.806824 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814374a43a85484e8e4095c5893dcfa8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.845144 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814374a43a85484e8e4095c5893dcfa8'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.860889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1328/2679] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/users => generated 284 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:38.860889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.862273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.875011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:38.893366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1352/2680] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:38 2022] DELETE /identity/v3/users/814374a43a85484e8e4095c5893dcfa8 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:38.897263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.901519 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:39.085563 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:39.086672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e61dd-cf7b-4c52-b20d-6bd4ac875120 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.108446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.111045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.111813 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.112760 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.114776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.117787 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.149738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1353/2681] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:39.152986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22c803-4985-4851-b43f-0b51017f01aa admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.159575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.183736 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21669da-1796-41c4-8d73-6f53b35cc8d7 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.204805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.205940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.205940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.206256 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.207200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.210823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.241007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1354/2682] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:39.242221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.266489 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cbedf-e2ce-46dc-92d7-05988309fba3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.280546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec09826-4dad-4fa2-9703-014a7ce9ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.288513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec09826-4dad-4fa2-9703-014a7ce9ca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.289208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec09826-4dad-4fa2-9703-014a7ce9ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.289563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec09826-4dad-4fa2-9703-014a7ce9ca16 admin admin] PATH_INFO: `/v3/projects/5585ed7e0c5a4ddab785c06cdf7c7647/users/585b5607401d42f588cdb0428e03d129/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.338828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec09826-4dad-4fa2-9703-014a7ce9ca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5585ed7e0c5a4ddab785c06cdf7c7647, user_id=585b5607401d42f588cdb0428e03d129, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.342889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec09826-4dad-4fa2-9703-014a7ce9ca16 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.348472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.350607 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.351537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.352323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.358646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:39.415544 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1355/2683] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:39 2022] PUT /identity/v3/projects/5585ed7e0c5a4ddab785c06cdf7c7647/users/585b5607401d42f588cdb0428e03d129/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:39.435913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2e90-541f-4ed8-beee-169f88bf7f08 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.436417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2e90-541f-4ed8-beee-169f88bf7f08 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.437207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a2e90-541f-4ed8-beee-169f88bf7f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.505900 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-653a2e90-541f-4ed8-beee-169f88bf7f08 None None] MFA Rules not processed for user `585b5607401d42f588cdb0428e03d129`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:39.507219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-653a2e90-541f-4ed8-beee-169f88bf7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:39.583059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.587364 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.645641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1329/2684] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:39.646356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.654207 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:39.689284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bd12b-020f-40f0-a320-33e9d23dc944 service nova] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.692775 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1356/2685] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:39.865697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.866558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.867262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.867262 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] PATH_INFO: `/v3/projects/7b3a60ed5f1c4c85a241ad148dde8d64` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.868472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3a60ed5f1c4c85a241ad148dde8d64)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.870849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.988761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:40.011549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3a60ed5f1c4c85a241ad148dde8d64', 'request_id': 'req-d6d303ef-941a-476a-9a5e-959785df978e'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:40.023433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3a60ed5f1c4c85a241ad148dde8d64', 'request_id': 'req-d6d303ef-941a-476a-9a5e-959785df978e'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:40.038571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3a60ed5f1c4c85a241ad148dde8d64', 'request_id': 'req-d6d303ef-941a-476a-9a5e-959785df978e'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:40.079581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] The token cache is being invalidate because project 7b3a60ed5f1c4c85a241ad148dde8d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:40.079924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:40.084983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d6d303ef-941a-476a-9a5e-959785df978e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:40.086789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1330/2686] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:39 2022] DELETE /identity/v3/projects/7b3a60ed5f1c4c85a241ad148dde8d64 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:40.096000 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.097059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.097682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.179768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:40.183459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.402614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:40.450074 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1357/2687] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:40.473106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.473106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.473708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.533977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:40.537786 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.543312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.545452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.567001 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1331/2688] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:40.569414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.593854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a1d9-b768-4749-9fed-2621af30550b None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.601691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.602560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.602915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.603258 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.604974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:40.605356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.607867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.632628 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1332/2689] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:40.647645 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.662514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76679250-f95c-4920-ab01-c9285c7852f0 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.669340 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.670113 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.670581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.670851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.671725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.674034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.674558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7822-efd5-4799-bd05-924096930ffb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.681508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2459051d2b42ad8a9c4d51568d2c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.682703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.683434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.683925 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.687458 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.731537 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1333/2690] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:40.733247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.869643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.876075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.886291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e83d2-85d9-4a5e-b48d-35f972317c31 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.889467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1358/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:40.903857 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.904623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.905051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.905328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.906342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.909763 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.964108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1334/2692] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:40.968424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.992696 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c188653-a2c1-42c4-9e2b-d206218e2a36 service glance] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.002593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.005163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.005571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.005877 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.006612 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.010238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.046450 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1359/2693] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:41.051127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:41.080287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aac72-c7e2-4a5d-a11f-c19051d32495 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.091839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878d3cd-5d6e-4ca3-b826-74ead13a6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.093048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878d3cd-5d6e-4ca3-b826-74ead13a6697 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.093595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878d3cd-5d6e-4ca3-b826-74ead13a6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.094099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878d3cd-5d6e-4ca3-b826-74ead13a6697 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.095334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878d3cd-5d6e-4ca3-b826-74ead13a6697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.099118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878d3cd-5d6e-4ca3-b826-74ead13a6697 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.146690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1335/2694] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:41.153480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:41.180543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf83a3-25e7-423f-a48f-7213a2920194 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.203345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.204408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.204913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.205445 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] PATH_INFO: `/v3/projects/a9d0d4a373814f9a8374dcc39c8d5c77/users/37a78a847fcf4adc8c0bbd48c0161cd0/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.234654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d0d4a373814f9a8374dcc39c8d5c77, user_id=37a78a847fcf4adc8c0bbd48c0161cd0, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.239135 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.289177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1360/2695] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:41 2022] PUT /identity/v3/projects/a9d0d4a373814f9a8374dcc39c8d5c77/users/37a78a847fcf4adc8c0bbd48c0161cd0/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:41.300528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.300860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.301109 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.363866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] MFA Rules not processed for user `37a78a847fcf4adc8c0bbd48c0161cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:41.367993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:41.461777 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:41.491451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:41.498557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1336/2696] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:41.696442 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ab76-5264-4d2a-a728-4d445bb93481 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.704156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.704916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.705303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.705657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.706389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.708800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.757975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:41.787303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1361/2697] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:41 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:41.807172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:41.858633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2263-06c9-4c13-8a84-149685de94f2 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:42.060467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:42.061307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.061696 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.062084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.063011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:42.065416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:42.097804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1337/2698] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:41 2022] POST /identity/v3/users => generated 290 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:42.099777 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:42.140037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3400-72f0-44b3-b854-952378238a7d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:42.148063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:42.150124 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.151318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.151814 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.153178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:42.156479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:42.179913 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1362/2699] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:42.186646 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:42.205465 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75831f-e1de-4029-b579-5c51004e6bac admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:42.213784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294854d-22e3-4338-8a47-e8018ad4cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:42.215028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294854d-22e3-4338-8a47-e8018ad4cfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.215499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294854d-22e3-4338-8a47-e8018ad4cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.216365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294854d-22e3-4338-8a47-e8018ad4cfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.216889 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294854d-22e3-4338-8a47-e8018ad4cfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:42.224350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294854d-22e3-4338-8a47-e8018ad4cfd3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:42.239107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1338/2700] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:42.241525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:42.253258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7b57a-9387-4017-a20f-a6fa6bc8bee5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:42.258713 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:42.259479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.260517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.260918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] PATH_INFO: `/v3/projects/abec4d66a5f045ed88f6397eb44dc2d5/users/5e8524fe15da4f9d9564fc9e0be0121c/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.284383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abec4d66a5f045ed88f6397eb44dc2d5, user_id=5e8524fe15da4f9d9564fc9e0be0121c, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:42.289166 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:42.307869 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1363/2701] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:42 2022] PUT /identity/v3/projects/abec4d66a5f045ed88f6397eb44dc2d5/users/5e8524fe15da4f9d9564fc9e0be0121c/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:42.319813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.320194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.320573 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.360926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] MFA Rules not processed for user `5e8524fe15da4f9d9564fc9e0be0121c`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:42.362674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:42.519503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1339/2702] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:42.524187 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:42.681323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f50fc-e6da-4643-8e86-533169f5de98 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:42.707194 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:42.708193 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.709022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.709411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.710425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:42.715042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:42.787147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1364/2703] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:42 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:42.792594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:42.813149 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff17b-d998-4848-afb4-a132a2d86d04 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:43.160025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:43.162435 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.163181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.163884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.165309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:43.171557 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:43.266568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:43.340839 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1340/2704] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:42 2022] POST /identity/v3/users => generated 296 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:43.342247 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:43.368937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d650d6-437e-4a63-a69d-9642f19760d8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:43.388384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:43.389554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.393203 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.393853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.396330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:43.412004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:43.458290 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1365/2705] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:43.466976 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:43.500291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7248a-30e5-4d9e-8602-51c5606bf7c2 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:43.524009 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:43.527910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.528448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.531236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] PATH_INFO: `/v3/projects/9e0c821b253f4e6a87c553a14e672bac/users/243f8a82f4174e13bf55bc69a896161c/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.598589 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0c821b253f4e6a87c553a14e672bac, user_id=243f8a82f4174e13bf55bc69a896161c, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:43.607064 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:43.661824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1341/2706] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:43 2022] PUT /identity/v3/projects/9e0c821b253f4e6a87c553a14e672bac/users/243f8a82f4174e13bf55bc69a896161c/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:43.669838 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:43.712522 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a340-6d77-4afc-ba1e-c901f6615c1a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:43.866632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13d14-bcb3-4544-ae85-1cef37a21dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:43.868132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13d14-bcb3-4544-ae85-1cef37a21dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.871015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13d14-bcb3-4544-ae85-1cef37a21dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.871580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13d14-bcb3-4544-ae85-1cef37a21dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.873095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13d14-bcb3-4544-ae85-1cef37a21dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:43.875057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c13d14-bcb3-4544-ae85-1cef37a21dd6 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:43.890394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1366/2707] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:43.894957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:43.914425 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a204674-79e3-434d-9101-088ed14de2f5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:43.936867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:43.937578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.938261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.938261 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] PATH_INFO: `/v3/projects/9e0c821b253f4e6a87c553a14e672bac/users/243f8a82f4174e13bf55bc69a896161c/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.940263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0c821b253f4e6a87c553a14e672bac, user_id=243f8a82f4174e13bf55bc69a896161c, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:43.942993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:43.977087 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1342/2708] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:43 2022] PUT /identity/v3/projects/9e0c821b253f4e6a87c553a14e672bac/users/243f8a82f4174e13bf55bc69a896161c/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:43.988901 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.989369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.989538 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.064385 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] MFA Rules not processed for user `243f8a82f4174e13bf55bc69a896161c`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:44.068214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.132189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:44.298878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1367/2709] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:44.315366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:44.319686 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.520168 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1afe4-fa6c-486b-b847-74d7f1ab5338 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.538906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.538906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.538906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.538906 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.584223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:44.601544 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:44.631594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1343/2710] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:44.715462 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:44.717716 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.750362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4a3f-f39c-405d-bfa3-825a40b0edc6 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.771746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.772392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.773195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.773195 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:45.021477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:45.027441 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:45.034556 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:45.036355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:45.084770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1368/2711] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:45.301370 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a5867-e0e6-43f9-8cfa-b2ccc243d67b service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:45.310847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:45.311475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:45.311755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:45.312031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:45.314810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:45.341842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:45.346315 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0111a-1210-49f5-903b-5619656f1ee5 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:45.385621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1344/2712] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:49.407423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:49.733261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044fc27-15dc-44f8-beef-89565de9f95b service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:49.752789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:49.763859 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.765223 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.766388 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] PATH_INFO: `/v3/users/37a78a847fcf4adc8c0bbd48c0161cd0` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.769881 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a78a847fcf4adc8c0bbd48c0161cd0)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:49.774812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.070685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a78a847fcf4adc8c0bbd48c0161cd0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:50.073274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a78a847fcf4adc8c0bbd48c0161cd0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:50.102310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:50.142794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a78a847fcf4adc8c0bbd48c0161cd0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:50.143996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a78a847fcf4adc8c0bbd48c0161cd0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:50.193539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a78a847fcf4adc8c0bbd48c0161cd0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:50.302175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1369/2713] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:49 2022] DELETE /identity/v3/users/37a78a847fcf4adc8c0bbd48c0161cd0 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:50.309165 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.310720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.310720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.405458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:50.406979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:50.546088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:50.648384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1345/2714] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:50.662783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:50.664672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:50.992077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b0ba-51f5-4faf-8b2d-b621b10aeb76 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:51.020690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:51.023178 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:51.024035 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:51.027906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:51.061325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:51.064493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:51.093650 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1370/2715] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:51.950069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:51.954103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:51.993160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfa9a7-4f4a-4351-8bff-60d51e6d40fb None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:52.024433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.027660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.029119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.030501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] PATH_INFO: `/v3/projects/a9d0d4a373814f9a8374dcc39c8d5c77` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.033515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d0d4a373814f9a8374dcc39c8d5c77)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.039542 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.171565 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d0d4a373814f9a8374dcc39c8d5c77', 'request_id': 'req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.201781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d0d4a373814f9a8374dcc39c8d5c77', 'request_id': 'req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.220048 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d0d4a373814f9a8374dcc39c8d5c77', 'request_id': 'req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.247859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] The token cache is being invalidate because project a9d0d4a373814f9a8374dcc39c8d5c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:52.248813 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.250508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.254913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1346/2716] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:51 2022] DELETE /identity/v3/projects/a9d0d4a373814f9a8374dcc39c8d5c77 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:52.260597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:52.274783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee6edb-566c-4fff-b117-5a608a798d58 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:52.353970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.354702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.354902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.355177 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] PATH_INFO: `/v3/users/5e8524fe15da4f9d9564fc9e0be0121c` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.356351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8524fe15da4f9d9564fc9e0be0121c)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.358363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.430628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8524fe15da4f9d9564fc9e0be0121c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.432376 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8524fe15da4f9d9564fc9e0be0121c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.450883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8524fe15da4f9d9564fc9e0be0121c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.452421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8524fe15da4f9d9564fc9e0be0121c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.467516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8524fe15da4f9d9564fc9e0be0121c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.485940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:52.506433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1371/2717] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:52 2022] DELETE /identity/v3/users/5e8524fe15da4f9d9564fc9e0be0121c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:52.887049 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:52.891171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:52.920103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030507fc-2b6f-48d6-bb23-8ebe34dcbc30 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:53.019794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:53.020948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:53.021368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:53.021845 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] PATH_INFO: `/v3/projects/abec4d66a5f045ed88f6397eb44dc2d5` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:53.023255 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abec4d66a5f045ed88f6397eb44dc2d5)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:53.025684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:53.091501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abec4d66a5f045ed88f6397eb44dc2d5', 'request_id': 'req-98dfe441-9c0b-4e22-a7ce-853f292d105f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.108798 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abec4d66a5f045ed88f6397eb44dc2d5', 'request_id': 'req-98dfe441-9c0b-4e22-a7ce-853f292d105f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.120089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abec4d66a5f045ed88f6397eb44dc2d5', 'request_id': 'req-98dfe441-9c0b-4e22-a7ce-853f292d105f'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.127695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:53.139647 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] The token cache is being invalidate because project abec4d66a5f045ed88f6397eb44dc2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:53.139988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.141074 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.143226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1347/2718] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:52 2022] DELETE /identity/v3/projects/abec4d66a5f045ed88f6397eb44dc2d5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:53.148557 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:53.150914 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:53.172266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a52fb-9070-4d4b-af82-6b95d3903655 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:53.271600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:53.272618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:53.273034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:53.273464 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] PATH_INFO: `/v3/users/243f8a82f4174e13bf55bc69a896161c` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:53.275474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=243f8a82f4174e13bf55bc69a896161c)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:53.277656 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:53.373661 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243f8a82f4174e13bf55bc69a896161c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.374374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243f8a82f4174e13bf55bc69a896161c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.384475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243f8a82f4174e13bf55bc69a896161c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.385242 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243f8a82f4174e13bf55bc69a896161c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.395867 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-277038a1-cd70-40a2-85a7-3587a01d6bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243f8a82f4174e13bf55bc69a896161c'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:53.426727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1372/2719] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:53 2022] DELETE /identity/v3/users/243f8a82f4174e13bf55bc69a896161c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:53.884171 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:53.886883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:53.906736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfe441-9c0b-4e22-a7ce-853f292d105f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.021863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.024209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.024209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.024209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] PATH_INFO: `/v3/projects/9e0c821b253f4e6a87c553a14e672bac` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.027221 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0c821b253f4e6a87c553a14e672bac)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.030949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.206223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0c821b253f4e6a87c553a14e672bac', 'request_id': 'req-106db8e2-28ef-43e0-8953-3f4b6eeac760'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.218428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0c821b253f4e6a87c553a14e672bac', 'request_id': 'req-106db8e2-28ef-43e0-8953-3f4b6eeac760'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.233580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0c821b253f4e6a87c553a14e672bac', 'request_id': 'req-106db8e2-28ef-43e0-8953-3f4b6eeac760'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.255952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] The token cache is being invalidate because project 9e0c821b253f4e6a87c553a14e672bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:54.256622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.257923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-106db8e2-28ef-43e0-8953-3f4b6eeac760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.264799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1348/2720] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:53 2022] DELETE /identity/v3/projects/9e0c821b253f4e6a87c553a14e672bac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:54.267912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.268418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.269026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.301265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:54.303373 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.411421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1373/2721] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:54.423981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.424486 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.424886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.450159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:54.451491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.467404 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1349/2722] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:54.472030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.490719 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c220f2-849c-4364-9161-81f77d15b6d7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.499052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.500044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.500516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.501084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.502230 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:54.503288 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.505592 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.518724 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:54.530756 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1374/2723] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:54.535496 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.549439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee262-5d40-4003-9718-cee7adf50475 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.555100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.555717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.556655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.557060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.558034 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.560024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.594141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1350/2724] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:54.598894 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.613636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46625-2068-4c5d-a2dc-e83c6528e536 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.722003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.722706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.722987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.723258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.724057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.726163 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.765184 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1375/2725] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:54.770500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.784235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca4745-65f1-4659-9a0f-fccc54bdaa46 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.791096 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.791810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.792516 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.792707 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.793501 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.795275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.823739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1351/2726] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:54.827527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.841448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c72172-c390-46aa-84e7-622afb6c2438 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.848444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db1581-19dd-4d7e-a1ad-a102fa1dacec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.849245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1581-19dd-4d7e-a1ad-a102fa1dacec admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.849572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1581-19dd-4d7e-a1ad-a102fa1dacec admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.849921 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db1581-19dd-4d7e-a1ad-a102fa1dacec admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.850641 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1581-19dd-4d7e-a1ad-a102fa1dacec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.852479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db1581-19dd-4d7e-a1ad-a102fa1dacec admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.867205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1376/2727] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:54.872397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.894477 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06709df-8096-49a0-bf38-19fa5d30fa35 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.903452 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.904515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.905114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.905575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] PATH_INFO: `/v3/projects/5c696e84ae6c442ca2a9c994c93dc930/users/cc39507c1a524b91ae51ff60ac2b3504/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.935506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c696e84ae6c442ca2a9c994c93dc930, user_id=cc39507c1a524b91ae51ff60ac2b3504, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.941220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.969494 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1352/2728] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:54 2022] PUT /identity/v3/projects/5c696e84ae6c442ca2a9c994c93dc930/users/cc39507c1a524b91ae51ff60ac2b3504/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:54.991027 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.991523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.992013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.047158 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] MFA Rules not processed for user `cc39507c1a524b91ae51ff60ac2b3504`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:55.048483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.189750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1377/2729] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:55.207353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.210147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.279264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:55.352342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa201d3-efaa-4ac9-a5cf-b2896d442899 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.362286 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.363245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.363690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.364117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.384849 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.388328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.406766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1353/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:55.435478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.577147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.577147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.622936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169f52c-fab2-4ffb-89cc-a7599889cc2f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.631426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.632391 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.632752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.633113 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] PATH_INFO: `/v3/users/cc39507c1a524b91ae51ff60ac2b3504` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.635297 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc39507c1a524b91ae51ff60ac2b3504)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.639805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.650791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:55.698750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516184-c0e8-4d72-968b-6fcba6799d6a service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.703077 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.703861 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.704353 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.704622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.707964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.724806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.726583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bfd29-677f-4dac-bfe9-b68d1d6758bf service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.740282 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc39507c1a524b91ae51ff60ac2b3504'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.741402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc39507c1a524b91ae51ff60ac2b3504'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.742054 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1354/2731] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:55.760802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc39507c1a524b91ae51ff60ac2b3504'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.762030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc39507c1a524b91ae51ff60ac2b3504'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.772971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc39507c1a524b91ae51ff60ac2b3504'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.800026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1378/2732] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:55 2022] DELETE /identity/v3/users/cc39507c1a524b91ae51ff60ac2b3504 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:55.807381 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.807883 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.809091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.841200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:55.842488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.972134 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1355/2733] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:55.980173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.982480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:56.062646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd1e91-472b-4d6f-ade3-632406555c89 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:56.066912 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7a6d0-d093-44ac-9e16-edb64b9d06d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:56.067690 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7a6d0-d093-44ac-9e16-edb64b9d06d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.068073 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7a6d0-d093-44ac-9e16-edb64b9d06d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.068451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7a6d0-d093-44ac-9e16-edb64b9d06d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.081002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7a6d0-d093-44ac-9e16-edb64b9d06d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:56.083532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7a6d0-d093-44ac-9e16-edb64b9d06d3 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:56.100143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1379/2734] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:56.596853 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:56.598732 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:56.630332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132864d7-53e3-4b25-9e2d-09d3654713df None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:56.637160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:56.639553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.640091 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.640967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] PATH_INFO: `/v3/projects/5c696e84ae6c442ca2a9c994c93dc930` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.643177 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c696e84ae6c442ca2a9c994c93dc930)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:56.646031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:56.820084 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c696e84ae6c442ca2a9c994c93dc930', 'request_id': 'req-64b33eb8-486a-4f93-ab19-9ef419ce420c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.835322 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c696e84ae6c442ca2a9c994c93dc930', 'request_id': 'req-64b33eb8-486a-4f93-ab19-9ef419ce420c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.851058 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c696e84ae6c442ca2a9c994c93dc930', 'request_id': 'req-64b33eb8-486a-4f93-ab19-9ef419ce420c'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.856506 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:56.888120 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] The token cache is being invalidate because project 5c696e84ae6c442ca2a9c994c93dc930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:56.888636 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.889836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-64b33eb8-486a-4f93-ab19-9ef419ce420c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.892577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1356/2735] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:56 2022] DELETE /identity/v3/projects/5c696e84ae6c442ca2a9c994c93dc930 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:56.897997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.899456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.901168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.928420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:56.930303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.003411 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1380/2736] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:57.011803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.012141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.012355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.034721 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:57.035963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.045147 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1357/2737] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:57.050922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.068791 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbe47-721f-40b7-9101-0b884cae9ee8 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.069344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.070532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.070806 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.071176 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.073060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:57.073425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.075516 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.099437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1381/2738] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:57.109051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.116541 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2696f-1376-4321-8fbc-8fa804c99fc9 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.124930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.125684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.125961 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.126345 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.126949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.129230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.165176 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1358/2739] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:57.168304 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.179423 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbeb85-368b-4dd5-84eb-6656ebd2e254 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.201006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:57.267359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.267987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.268456 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.268989 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.269758 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.272123 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.301322 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1382/2740] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:57.302545 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.316498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce036-c1fb-4316-8e82-46bed8000c70 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.326267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.327218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.327673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.328323 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.329527 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.332560 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.353890 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1359/2741] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:57.359153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.378362 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181949-3bb2-4bf6-b5d5-04224476bbe2 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.388946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c19e2-f6de-468e-adbe-ec91496cef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.389554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c19e2-f6de-468e-adbe-ec91496cef95 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.390042 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c19e2-f6de-468e-adbe-ec91496cef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.390499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c19e2-f6de-468e-adbe-ec91496cef95 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.391715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c19e2-f6de-468e-adbe-ec91496cef95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.394899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c19e2-f6de-468e-adbe-ec91496cef95 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.436997 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1383/2742] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:57.442106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.456304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f69a90-a632-48f2-b530-72f3fa085f3e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.466059 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.467256 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.467811 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.468301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] PATH_INFO: `/v3/projects/d5855f8d97a6462c9cb3a9a371bdcfac/users/40324fc65b7948e7a46f906df7c2f39d/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.494742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5855f8d97a6462c9cb3a9a371bdcfac, user_id=40324fc65b7948e7a46f906df7c2f39d, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.498595 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.532766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1360/2743] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:57 2022] PUT /identity/v3/projects/d5855f8d97a6462c9cb3a9a371bdcfac/users/40324fc65b7948e7a46f906df7c2f39d/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:57.546032 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.546406 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.546578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.595750 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] MFA Rules not processed for user `40324fc65b7948e7a46f906df7c2f39d`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:57.597218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.729325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1384/2744] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:57.740330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.742335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.823741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d186290-081d-40c8-81f5-62dd326a666e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.833922 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7682f-32c7-44ba-8e6b-4d583e0c80c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.835418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7682f-32c7-44ba-8e6b-4d583e0c80c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.835802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7682f-32c7-44ba-8e6b-4d583e0c80c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.836061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7682f-32c7-44ba-8e6b-4d583e0c80c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.848913 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7682f-32c7-44ba-8e6b-4d583e0c80c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.850138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7682f-32c7-44ba-8e6b-4d583e0c80c1 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.875334 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1361/2745] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:57.907477 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.997768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d040b-9a55-4f1d-b549-b6639bdaae12 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.004349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.005354 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.005897 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.006397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] PATH_INFO: `/v3/users/40324fc65b7948e7a46f906df7c2f39d` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.009685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=40324fc65b7948e7a46f906df7c2f39d)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.012212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.102478 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:58.168316 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40324fc65b7948e7a46f906df7c2f39d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.171555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40324fc65b7948e7a46f906df7c2f39d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.173632 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.174112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.174592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.190447 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40324fc65b7948e7a46f906df7c2f39d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.192082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40324fc65b7948e7a46f906df7c2f39d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.204754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-32c5414b-9ae7-4948-b858-9b3d6bb3c8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40324fc65b7948e7a46f906df7c2f39d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.234969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:58.234969 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.252701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1385/2746] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:57 2022] DELETE /identity/v3/users/40324fc65b7948e7a46f906df7c2f39d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:58.255099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.255589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.255947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.298018 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:58.299271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.412564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1362/2747] 10.222.0.45 () {58 vars in 967 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:58.428912 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.432983 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.573357 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1386/2748] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:58.584139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:58.595395 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.597972 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.632842 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9ade-bf93-452d-b75f-118d945819a6 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.723869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.724806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.725047 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.726070 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.755349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536e836-345c-489a-aef8-fe093b4b37d7 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.763355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.764548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.765457 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.765636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.787420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.792470 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.811227 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1387/2749] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:58.821287 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.824201 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.848505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1363/2750] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:53:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:53:58.988582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.003165 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579b50f-52b7-4388-9b3d-3323702ad230 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.010694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.010903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.011258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.011432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.014962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:59.178674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:59.222429 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.226534 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ced16-d4a5-49ae-90dc-1882ff4ba45a service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.245175 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1388/2751] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:59.633712 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.636264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:59.667548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a96f-4299-4101-8ae4-fffa5d00e9ed service swift] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.699754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.703069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.703387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.703663 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] PATH_INFO: `/v3/projects/d5855f8d97a6462c9cb3a9a371bdcfac` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.705231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5855f8d97a6462c9cb3a9a371bdcfac)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.707784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.880888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5855f8d97a6462c9cb3a9a371bdcfac', 'request_id': 'req-42048078-cff0-4a9e-bb81-28e4fc1c72c8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.901514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5855f8d97a6462c9cb3a9a371bdcfac', 'request_id': 'req-42048078-cff0-4a9e-bb81-28e4fc1c72c8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.917555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5855f8d97a6462c9cb3a9a371bdcfac', 'request_id': 'req-42048078-cff0-4a9e-bb81-28e4fc1c72c8'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.944464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] The token cache is being invalidate because project d5855f8d97a6462c9cb3a9a371bdcfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:59.945125 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.945998 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-42048078-cff0-4a9e-bb81-28e4fc1c72c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.949549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1364/2752] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:59 2022] DELETE /identity/v3/projects/d5855f8d97a6462c9cb3a9a371bdcfac => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:59.955808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.956098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.956384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.999767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.000936 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.178783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1389/2753] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:00.187921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.188403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.188942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.204688 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:00.229569 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.231892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.263508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.266159 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1365/2754] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:00.280409 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b675a-0cfc-4920-a298-7d4e0e08520e None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.289403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.290613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.291114 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.291580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.292558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:54:00.292922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.297591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.317566 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1390/2755] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:54:00.322778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.334369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dfeb-3257-4590-897e-99caa44e0184 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.342554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.343248 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.343684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.343962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.344664 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.347116 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.389381 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.389739 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1366/2756] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:00.401097 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1d9d-b8e2-47b4-b94a-d1a7324ea3e8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.542767 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.543934 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.544218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.544494 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.545951 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.549015 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.581999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1391/2757] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:54:00.583918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.597673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74197e-f7ce-41ba-b2e0-ba73fa98ef77 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.608690 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.609602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.609910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.610193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.610865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.614564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.637145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1367/2758] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:00.638394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.658383 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9046733-0f0f-463b-bc0d-ddc4469c10c8 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.667546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4aea7-0608-4005-8cb1-d8cdf2a7e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.669397 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4aea7-0608-4005-8cb1-d8cdf2a7e2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.671133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4aea7-0608-4005-8cb1-d8cdf2a7e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.671505 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4aea7-0608-4005-8cb1-d8cdf2a7e2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.672283 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4aea7-0608-4005-8cb1-d8cdf2a7e2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.674974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4aea7-0608-4005-8cb1-d8cdf2a7e2c4 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.688771 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1392/2759] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:00.692866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.706023 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b5f2-8fde-4696-8e30-1d097aca8d6a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.712810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.713982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.714816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.715403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] PATH_INFO: `/v3/projects/2d36ec66444842f499aa2db95b6c0d2e/users/b5a79c0ba7eb4bb6ba5a0a73565ac4f5/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.733886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d36ec66444842f499aa2db95b6c0d2e, user_id=b5a79c0ba7eb4bb6ba5a0a73565ac4f5, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.737366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.760785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1368/2760] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:00 2022] PUT /identity/v3/projects/2d36ec66444842f499aa2db95b6c0d2e/users/b5a79c0ba7eb4bb6ba5a0a73565ac4f5/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:54:00.773218 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.773593 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.775309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.816390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] MFA Rules not processed for user `b5a79c0ba7eb4bb6ba5a0a73565ac4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.817699 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.892954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:00.999200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1393/2761] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:01.023063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.025659 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.216372 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1343-a275-44af-88eb-ac76cfe70f90 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.222306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.223124 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.223407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.224305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.240244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.241869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.266962 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1369/2762] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:02.122963 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.125905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:02.277082 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d780-fa68-4958-a99f-eb9f074ee572 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.285628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.286363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.286702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.287084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.289119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:02.303119 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.305045 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad553268-40ac-4b47-94bb-09a65a106cee service placement] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.317899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1394/2763] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:06.173174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:06.175020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.363789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ff72a-666a-4fad-93ac-ad28fac870ce service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:06.378788 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:06.379718 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:06.380098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:06.380680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] PATH_INFO: `/v3/users/585b5607401d42f588cdb0428e03d129` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:06.382356 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585b5607401d42f588cdb0428e03d129)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:06.385232 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:06.452082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:06.454161 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585b5607401d42f588cdb0428e03d129'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:06.455222 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585b5607401d42f588cdb0428e03d129'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:06.468611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585b5607401d42f588cdb0428e03d129'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:06.479656 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585b5607401d42f588cdb0428e03d129'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:06.480495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585b5607401d42f588cdb0428e03d129'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:06.509815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1370/2764] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:06 2022] DELETE /identity/v3/users/585b5607401d42f588cdb0428e03d129 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:06.512211 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:06.512915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:06.512915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:06.535153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:06.536341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.615658 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1395/2765] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:06.627762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:06.629522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.733361 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697b23d-2ee0-4fcb-a093-943abf5d70a9 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:06.740611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9dc56-28b4-470d-957d-9c01df68c161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:06.740611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9dc56-28b4-470d-957d-9c01df68c161 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:06.740611 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9dc56-28b4-470d-957d-9c01df68c161 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:06.741281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9dc56-28b4-470d-957d-9c01df68c161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:06.752552 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9dc56-28b4-470d-957d-9c01df68c161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:06.754294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9dc56-28b4-470d-957d-9c01df68c161 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:06.766591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1371/2766] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:07.011883 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:07.014554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.034010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4149b-5ea3-4027-98c3-c44d3a42249d None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:07.040134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:07.041115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.041918 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.043488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] PATH_INFO: `/v3/users/b5a79c0ba7eb4bb6ba5a0a73565ac4f5` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.045198 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a79c0ba7eb4bb6ba5a0a73565ac4f5)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:07.048639 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:07.153044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a79c0ba7eb4bb6ba5a0a73565ac4f5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.154321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a79c0ba7eb4bb6ba5a0a73565ac4f5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.167591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a79c0ba7eb4bb6ba5a0a73565ac4f5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.168390 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a79c0ba7eb4bb6ba5a0a73565ac4f5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.173954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:07.183459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a79c0ba7eb4bb6ba5a0a73565ac4f5'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.232776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1396/2767] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:07 2022] DELETE /identity/v3/users/b5a79c0ba7eb4bb6ba5a0a73565ac4f5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:07.240204 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.240870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.241291 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.286478 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:07.288549 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.417880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1372/2768] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:07.426684 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:07.429296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.525716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:07.529691 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.551479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425b0a-282a-4ded-8ce8-bb98e9f3046a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:07.552532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee83ca5-ff3f-44a2-98ec-f98ea8e59693 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:07.558459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f645ca9-92b6-498d-b493-ed455fa1980d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:07.559600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645ca9-92b6-498d-b493-ed455fa1980d service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.560216 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645ca9-92b6-498d-b493-ed455fa1980d service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.560870 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f645ca9-92b6-498d-b493-ed455fa1980d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.561139 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:07.562236 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.562725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.563213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] PATH_INFO: `/v3/projects/5585ed7e0c5a4ddab785c06cdf7c7647` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.565608 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5585ed7e0c5a4ddab785c06cdf7c7647)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:07.569877 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:07.583147 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645ca9-92b6-498d-b493-ed455fa1980d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:07.588248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f645ca9-92b6-498d-b493-ed455fa1980d service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:07.646476 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1397/2769] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:07.691129 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5585ed7e0c5a4ddab785c06cdf7c7647', 'request_id': 'req-4280a440-3e41-4e87-8699-d6ce8929ddbc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.713218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5585ed7e0c5a4ddab785c06cdf7c7647', 'request_id': 'req-4280a440-3e41-4e87-8699-d6ce8929ddbc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.720669 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:07.742154 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5585ed7e0c5a4ddab785c06cdf7c7647', 'request_id': 'req-4280a440-3e41-4e87-8699-d6ce8929ddbc'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.766297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] The token cache is being invalidate because project 5585ed7e0c5a4ddab785c06cdf7c7647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:07.767073 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.767949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-4280a440-3e41-4e87-8699-d6ce8929ddbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.770110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1373/2770] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:07 2022] DELETE /identity/v3/projects/5585ed7e0c5a4ddab785c06cdf7c7647 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:07.777809 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.778270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.778704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.814571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:07.816568 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.912853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1398/2771] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:07.919743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.919984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.920166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.946948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:07.948362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.958106 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1374/2772] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:07.963743 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:07.982567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649bdb8-19cb-4630-84c8-1f8de5751e6f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:07.992950 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:07.994126 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.994518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.994998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.995975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:54:07.998269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.003823 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.027800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1399/2773] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:54:08.029163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.049275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ba277-f78b-49c8-89e2-ae0ab59bd260 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.057531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.058564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.059175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.059660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.060876 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.064447 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.109415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1375/2774] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:08.109598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.124234 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05694e-3a9b-4e81-a3ca-940d5b48fcdc admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.217966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.218747 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.219312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.220289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.220674 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.223004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.246672 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.276660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.286151 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1400/2775] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:54:08.294318 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf25df-71bc-47b7-8f5c-b15fa508b591 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.308854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.310301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.311276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.312371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.314131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.320590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.346382 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1376/2776] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:08.351258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.373351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320187b-d589-49c0-829e-ed1923f38779 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.385004 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb82f5-4b96-48c7-8fb1-26a6866f81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.385830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb82f5-4b96-48c7-8fb1-26a6866f81a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.386399 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb82f5-4b96-48c7-8fb1-26a6866f81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.386728 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb82f5-4b96-48c7-8fb1-26a6866f81a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.387588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb82f5-4b96-48c7-8fb1-26a6866f81a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.389532 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb82f5-4b96-48c7-8fb1-26a6866f81a4 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.407351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1401/2777] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:08.411799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.423733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421673c7-870f-44ac-be98-40d722f22990 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.428974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.430273 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.430719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.431578 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] PATH_INFO: `/v3/projects/64b8dc36ed2c41b0a4457dc795aa772e/users/9d8b49f3dd9f47c1bc6bda85e76324ff/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.468226 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b8dc36ed2c41b0a4457dc795aa772e, user_id=9d8b49f3dd9f47c1bc6bda85e76324ff, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.471060 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.489271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1377/2778] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:08 2022] PUT /identity/v3/projects/64b8dc36ed2c41b0a4457dc795aa772e/users/9d8b49f3dd9f47c1bc6bda85e76324ff/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:54:08.495235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.495525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.495703 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.519692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:08.521002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.609119 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.611564 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.616759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1402/2779] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:08.631163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acea9e-7925-4e48-ad7b-01e48df6fff6 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.635182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.637172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.644599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.645616 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.646117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.646553 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] PATH_INFO: `/v3/projects/2d36ec66444842f499aa2db95b6c0d2e` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.648062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d36ec66444842f499aa2db95b6c0d2e)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.651343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.724279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d36ec66444842f499aa2db95b6c0d2e', 'request_id': 'req-74ead78a-9bb4-4488-8bc8-499c87c275fb'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:08.736194 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d36ec66444842f499aa2db95b6c0d2e', 'request_id': 'req-74ead78a-9bb4-4488-8bc8-499c87c275fb'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:08.740786 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9d26-b4a2-4308-9173-6a28859a10f1 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.745797 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d36ec66444842f499aa2db95b6c0d2e', 'request_id': 'req-74ead78a-9bb4-4488-8bc8-499c87c275fb'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:08.763747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] The token cache is being invalidate because project 2d36ec66444842f499aa2db95b6c0d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:08.764141 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:08.764930 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:08.768834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1378/2780] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:08 2022] DELETE /identity/v3/projects/2d36ec66444842f499aa2db95b6c0d2e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:08.823687 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.824343 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.824751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.825134 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.828274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.852708 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.886654 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.936426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.944832 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.948328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.963653 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1403/2781] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:09.032407 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ead78a-9bb4-4488-8bc8-499c87c275fb admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:09.041413 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:09.042429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:09.048639 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:09.049719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] PATH_INFO: `/v3/users/e46c68f2a2504187b9d0d03a0236799a` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:09.051822 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46c68f2a2504187b9d0d03a0236799a)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:09.056233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:09.069012 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:09.146633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46c68f2a2504187b9d0d03a0236799a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.147326 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46c68f2a2504187b9d0d03a0236799a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.156475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46c68f2a2504187b9d0d03a0236799a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.165722 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46c68f2a2504187b9d0d03a0236799a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.166887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46c68f2a2504187b9d0d03a0236799a'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.196455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1379/2782] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:08 2022] DELETE /identity/v3/users/e46c68f2a2504187b9d0d03a0236799a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:09.573002 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:09.584572 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c911031-a216-4088-8e1e-534dbe802d4e service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:09.664692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:09.665966 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:09.666303 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:09.666418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] PATH_INFO: `/v3/projects/bd513f9fa41f4afca85493896732d16c` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:09.667560 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd513f9fa41f4afca85493896732d16c)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:09.669558 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:09.737778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd513f9fa41f4afca85493896732d16c', 'request_id': 'req-043df7d0-0b75-44ca-a40d-a99b55a8a165'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.746200 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd513f9fa41f4afca85493896732d16c', 'request_id': 'req-043df7d0-0b75-44ca-a40d-a99b55a8a165'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.756238 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd513f9fa41f4afca85493896732d16c', 'request_id': 'req-043df7d0-0b75-44ca-a40d-a99b55a8a165'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.770576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] The token cache is being invalidate because project bd513f9fa41f4afca85493896732d16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:09.770878 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.771638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-043df7d0-0b75-44ca-a40d-a99b55a8a165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.776527 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1404/2783] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:09 2022] DELETE /identity/v3/projects/bd513f9fa41f4afca85493896732d16c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:09.777874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:09.782824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:09.808623 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71953bea-71bc-49e7-b5d3-596f3a6e533b admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:09.857236 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:09.857574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:09.857909 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:09.894433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:09.895104 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:09.895468 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:09.895815 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] PATH_INFO: `/v3/users/ca381d84429345cead106563c94788b5` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:09.896482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] MFA Rules not processed for user `9d8b49f3dd9f47c1bc6bda85e76324ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:09.897359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca381d84429345cead106563c94788b5)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:09.898133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:09.900164 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:09.966631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca381d84429345cead106563c94788b5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.967227 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca381d84429345cead106563c94788b5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.976831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca381d84429345cead106563c94788b5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.988944 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca381d84429345cead106563c94788b5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:09.993095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca381d84429345cead106563c94788b5'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:10.024458 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1380/2784] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:09 2022] DELETE /identity/v3/users/ca381d84429345cead106563c94788b5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:10.036430 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1405/2785] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:10.045085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:10.047475 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:10.059834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:10.160301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfde998-3a65-4719-a0be-17bde5024fb1 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:10.166235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbafd9-e6b9-4ae2-b5ab-55c0007f5d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:10.166974 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbafd9-e6b9-4ae2-b5ab-55c0007f5d1b service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:10.167335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbafd9-e6b9-4ae2-b5ab-55c0007f5d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:10.168387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbafd9-e6b9-4ae2-b5ab-55c0007f5d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:10.237982 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbafd9-e6b9-4ae2-b5ab-55c0007f5d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:10.239503 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbafd9-e6b9-4ae2-b5ab-55c0007f5d1b service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:10.251907 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1381/2786] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:10.257498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:10.263313 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:10.296498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede42dcc-67b3-4f93-af5e-e9d1f9108969 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:10.314749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:10.382628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:10.383654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:10.383991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:10.384328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] PATH_INFO: `/v3/projects/574f603153f44dc4839551d59497f550` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:10.385889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574f603153f44dc4839551d59497f550)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:10.388491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:10.474559 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574f603153f44dc4839551d59497f550', 'request_id': 'req-f571f5cb-6004-4647-b5b7-36d436737262'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:10.488893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574f603153f44dc4839551d59497f550', 'request_id': 'req-f571f5cb-6004-4647-b5b7-36d436737262'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:10.499461 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574f603153f44dc4839551d59497f550', 'request_id': 'req-f571f5cb-6004-4647-b5b7-36d436737262'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:10.513239 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] The token cache is being invalidate because project 574f603153f44dc4839551d59497f550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:10.513579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:10.514287 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:10.515957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1406/2787] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:10 2022] DELETE /identity/v3/projects/574f603153f44dc4839551d59497f550 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:11.860825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe927-83e9-47b0-bc5b-1e296d4642eb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:11.861511 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe927-83e9-47b0-bc5b-1e296d4642eb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:11.861667 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe927-83e9-47b0-bc5b-1e296d4642eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:11.885621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-2adbe927-83e9-47b0-bc5b-1e296d4642eb None None] MFA Rules not processed for user `9d8b49f3dd9f47c1bc6bda85e76324ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:11.887868 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2adbe927-83e9-47b0-bc5b-1e296d4642eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:11.952666 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1382/2788] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:12.259523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:12.262091 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:12.334474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571f5cb-6004-4647-b5b7-36d436737262 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:12.339513 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:12.340155 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:12.340425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:12.340697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:12.342585 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:12.353523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:12.355076 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:12.364680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1407/2789] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:21.943337 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=71 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:22.360318 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:39.654601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7634d1-25f7-4cce-80ef-d6bcdf264644 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:39.655215 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7634d1-25f7-4cce-80ef-d6bcdf264644 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:39.655449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7634d1-25f7-4cce-80ef-d6bcdf264644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:39.677905 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-9a7634d1-25f7-4cce-80ef-d6bcdf264644 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:39.679304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-9a7634d1-25f7-4cce-80ef-d6bcdf264644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:39.754583 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1383/2790] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:39.795759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:39.797258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:39.882733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add95e-581c-486e-9a22-1ce6b126d852 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:39.888057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:39.888662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:39.888968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:39.889237 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:39.898493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:39.900084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:39.910497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1408/2791] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:42.756638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:42.756638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:42.756638 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:42.775741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:42.777011 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:42.785080 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1384/2792] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:42.799551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:42.815579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b74f3-4345-4e8a-8965-c39449b74d18 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:42.821711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c1680-4c58-4fc1-89e1-ea36989f2cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:42.822384 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1680-4c58-4fc1-89e1-ea36989f2cad service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:42.822729 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1680-4c58-4fc1-89e1-ea36989f2cad service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:42.823047 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c1680-4c58-4fc1-89e1-ea36989f2cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:42.834382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c1680-4c58-4fc1-89e1-ea36989f2cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:42.836591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c1680-4c58-4fc1-89e1-ea36989f2cad service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:42.854897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:42.858712 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1409/2793] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:42.865338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f699889-539f-41d8-997d-e2dae5fe7fe2 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:42.869375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:42.869993 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:42.870272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:42.870548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:42.873247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:42.889313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:42.890789 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:42.905063 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1385/2794] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:46.127551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.139571 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.140752 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.143754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.149758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.184927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:46.186783 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.214961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1410/2795] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:46.216906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.218493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.243483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88567e2-d548-4a2c-afc8-82b2ef965963 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:46.249359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:46.250031 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.250359 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.250636 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] PATH_INFO: `/v3/users/0d79b76436a8435ea4718ef91c21c712` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.251927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d79b76436a8435ea4718ef91c21c712)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:46.254392 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:46.330704 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d79b76436a8435ea4718ef91c21c712'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.331500 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d79b76436a8435ea4718ef91c21c712'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.341069 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10226a6-a958-422e-b9f0-b6a5f81a79a9 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:46.346648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:46.347307 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.347605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.347875 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.349553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d79b76436a8435ea4718ef91c21c712'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.349814 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.350805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d79b76436a8435ea4718ef91c21c712'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.363359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:46.363664 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d79b76436a8435ea4718ef91c21c712'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.365021 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:46.377263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1386/2796] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:46.378140 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.392386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1411/2797] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:46 2022] DELETE /identity/v3/users/0d79b76436a8435ea4718ef91c21c712 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:46.397342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a69143-5f7c-43ae-a810-c33d623a504c service placement] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:46.472767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:46.473347 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.473635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.473910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.475919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.482492 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:46.547401 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:46.549282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eb87f-05b6-46d4-a34a-985fedee4b6c service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:46.562554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1387/2798] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:46.586173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.587792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.611873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ea1e-b992-460c-a5df-165de905a47a admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:46.617426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:46.618079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.618358 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.618631 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] PATH_INFO: `/v3/projects/3c4e5ef86b874d8abdc5cb6fde17d421` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.619800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4e5ef86b874d8abdc5cb6fde17d421)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:46.621978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:46.660711 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:46.674931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4e5ef86b874d8abdc5cb6fde17d421', 'request_id': 'req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.684503 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4e5ef86b874d8abdc5cb6fde17d421', 'request_id': 'req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.694715 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4e5ef86b874d8abdc5cb6fde17d421', 'request_id': 'req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.705710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] The token cache is being invalidate because project 3c4e5ef86b874d8abdc5cb6fde17d421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:46.706183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.706873 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d89f87a7-2ca6-490d-a19b-0b2f9de4ce3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:46.708425 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1412/2799] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:46 2022] DELETE /identity/v3/projects/3c4e5ef86b874d8abdc5cb6fde17d421 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:46.715590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.716135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.716454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.736867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:46.737979 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.808460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1388/2800] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:46.816262 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.816546 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.816868 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.838733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:46.839961 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:46.847872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1413/2801] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:46.852265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.862525 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda297f-e826-4a0c-ba37-018f598d23a5 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:46.867548 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:46.868172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.868450 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.869343 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.869487 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:54:46.869729 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:46.871330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:46.884189 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1389/2802] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:54:46.888923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.899337 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631d6a6-44aa-48bd-a703-08a533645ef8 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:46.904415 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:46.905095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:46.905375 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:46.905662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:46.906286 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:46.908207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:46.946036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1414/2803] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:46 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:46.947411 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:46.957747 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc8228-c9aa-4016-b991-cac7b4510f47 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.024228 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.024960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.025193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.025461 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.026135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.028015 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.058716 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1390/2804] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:46 2022] POST /identity/v3/users => generated 278 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:54:47.060244 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.073137 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ee4e-99e7-4de6-bd89-81d5dee3135c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.078252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.078864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.079140 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.079410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.080048 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.081695 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.096044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1415/2805] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:47.100090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.110881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5665a-b0d7-48de-832f-f4a1484b66db admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.115680 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d70708-efa7-49e0-ac9d-5ce9c624fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.116975 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d70708-efa7-49e0-ac9d-5ce9c624fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.117473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d70708-efa7-49e0-ac9d-5ce9c624fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.117767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d70708-efa7-49e0-ac9d-5ce9c624fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.118427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d70708-efa7-49e0-ac9d-5ce9c624fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.120062 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d70708-efa7-49e0-ac9d-5ce9c624fe7a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.132694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1391/2806] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:47.137081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.147291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff10d2-08ca-4ec1-9627-7542a89788b0 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.152132 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.152841 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.153121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.153394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] PATH_INFO: `/v3/projects/4e125d4acd224715a0e59189722efd7f/users/2f124d48df9d41048a6fb98329d90159/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.168589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e125d4acd224715a0e59189722efd7f, user_id=2f124d48df9d41048a6fb98329d90159, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.171274 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.185363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1416/2807] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:47 2022] PUT /identity/v3/projects/4e125d4acd224715a0e59189722efd7f/users/2f124d48df9d41048a6fb98329d90159/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:47.196339 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.196847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.196986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.217328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:47.227996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] MFA Rules not processed for user `2f124d48df9d41048a6fb98329d90159`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:47.229303 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:47.295694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1392/2808] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:47.300433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.365614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f93adb-9034-45c4-b5cb-19d06971948b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.371250 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.371860 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.372139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.372413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.373077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.375007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.404839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1417/2809] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:47 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:47.409118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.420869 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba7ba-647d-41bb-82f9-202d0b177c34 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.479957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.480570 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.480887 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.481213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.481833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.483733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.506044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1393/2810] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:47 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:54:47.510202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.520449 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbf11-07d4-4033-b8c3-32e12054944b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.525591 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.526207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.526495 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.526770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.527428 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.537133 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.549597 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1418/2811] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:47.554449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.565185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b196b7-c2aa-4fae-84ea-683098271ac4 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.570225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.570892 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.571169 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.571439 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] PATH_INFO: `/v3/projects/ab339d37f9934cbfb79b533056348688/users/645343c5689a4e12a73980abb03d35f9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.587881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab339d37f9934cbfb79b533056348688, user_id=645343c5689a4e12a73980abb03d35f9, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.590817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.604244 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1394/2812] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:47 2022] PUT /identity/v3/projects/ab339d37f9934cbfb79b533056348688/users/645343c5689a4e12a73980abb03d35f9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:47.608485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.618915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9ea0f-273d-4edd-b650-c96a1581a477 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.649038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:47.691079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adb317-392d-4aab-bc78-cd2871127f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.691680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb317-392d-4aab-bc78-cd2871127f44 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.691991 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb317-392d-4aab-bc78-cd2871127f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.692215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adb317-392d-4aab-bc78-cd2871127f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.692947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb317-392d-4aab-bc78-cd2871127f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.694766 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adb317-392d-4aab-bc78-cd2871127f44 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.706075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1419/2813] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:47.711512 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.723181 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ee534-a154-4143-8c2f-1619d79d29f7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.729419 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.730100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.730390 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.730662 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] PATH_INFO: `/v3/projects/ab339d37f9934cbfb79b533056348688/users/645343c5689a4e12a73980abb03d35f9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.732568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab339d37f9934cbfb79b533056348688, user_id=645343c5689a4e12a73980abb03d35f9, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.735251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.746491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1395/2814] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:47 2022] PUT /identity/v3/projects/ab339d37f9934cbfb79b533056348688/users/645343c5689a4e12a73980abb03d35f9/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:54:47.758727 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.759014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.759291 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.791084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] MFA Rules not processed for user `645343c5689a4e12a73980abb03d35f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:47.792310 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:47.874654 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1420/2815] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:47.886387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:47.888213 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:47.956764 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c0d93-73a2-47ea-8a89-982c0fe55ac3 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:47.962298 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fb927-65d8-43dd-b6ba-2062d3037a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:47.962943 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb927-65d8-43dd-b6ba-2062d3037a8e service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:47.963476 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb927-65d8-43dd-b6ba-2062d3037a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:47.963825 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb927-65d8-43dd-b6ba-2062d3037a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:47.970198 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:47.976733 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fb927-65d8-43dd-b6ba-2062d3037a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:47.978572 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fb927-65d8-43dd-b6ba-2062d3037a8e service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:47.992429 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1396/2816] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:48.086930 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:48.089915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:48.108455 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341874-8bff-43d1-9aa2-4d97c676c8ff None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:48.113472 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:48.114108 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:48.114410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:48.115257 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:48.184886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:48.186341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:48.196309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1421/2817] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:49.212100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f6822-b6c7-4b57-aa91-764a6fd198fd None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:49.212588 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f6822-b6c7-4b57-aa91-764a6fd198fd None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:49.212692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f6822-b6c7-4b57-aa91-764a6fd198fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:49.233438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-312f6822-b6c7-4b57-aa91-764a6fd198fd None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:49.234648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-312f6822-b6c7-4b57-aa91-764a6fd198fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:49.294174 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1397/2818] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:49.309910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:49.311289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:49.372109 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:49.395480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ef61-f6d4-4f5d-b85e-3c17161b5155 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:49.405308 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:49.406012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:49.406270 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:49.406548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:49.417265 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:49.419025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:49.432168 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1422/2819] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:52.393620 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef9db-6829-40c1-8dc4-ba8fc429f536 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:52.394144 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef9db-6829-40c1-8dc4-ba8fc429f536 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:52.394264 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef9db-6829-40c1-8dc4-ba8fc429f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:52.415338 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-dc2ef9db-6829-40c1-8dc4-ba8fc429f536 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:52.416566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-dc2ef9db-6829-40c1-8dc4-ba8fc429f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:52.428772 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1398/2820] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:52.445488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:52.446833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:52.464962 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83b8aa-4ce7-43ad-8cc8-703e79407efb service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:52.470831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:52.471433 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:52.471720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:52.471990 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:52.481451 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:52.483030 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:52.493849 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1423/2821] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:55.582618 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:55.583229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:55.583229 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:55.607038 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:55.608267 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:55.616336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1399/2822] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:55.631943 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:55.643576 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b02d1-fd84-4dc6-85b5-dd19bceed22f service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:55.649319 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad42a07-8d67-4a6e-8c30-82fa419dd2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:55.650025 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad42a07-8d67-4a6e-8c30-82fa419dd2e2 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:55.650498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad42a07-8d67-4a6e-8c30-82fa419dd2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:55.650781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad42a07-8d67-4a6e-8c30-82fa419dd2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:55.659128 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad42a07-8d67-4a6e-8c30-82fa419dd2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:55.660741 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad42a07-8d67-4a6e-8c30-82fa419dd2e2 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:55.671660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1424/2823] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:03.495379 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.505357 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126168cc-2a70-401e-aafb-242ac200bc4d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.511206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.511852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.512132 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.512403 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] PATH_INFO: `/v3/users/2f124d48df9d41048a6fb98329d90159` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.513605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f124d48df9d41048a6fb98329d90159)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.515524 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.565093 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f124d48df9d41048a6fb98329d90159'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:03.565757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f124d48df9d41048a6fb98329d90159'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:03.573977 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f124d48df9d41048a6fb98329d90159'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:03.582306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f124d48df9d41048a6fb98329d90159'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:03.583086 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f124d48df9d41048a6fb98329d90159'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:03.602276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1400/2824] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:03 2022] DELETE /identity/v3/users/2f124d48df9d41048a6fb98329d90159 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:03.607271 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.607825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.607825 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.629070 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:03.630314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.710955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1425/2825] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:03.722942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.724609 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.795313 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c582-89c0-445c-a31a-a83e0e1d8372 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.800847 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.801792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.802308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.802810 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.815128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:03.818019 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.819605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.833621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1401/2826] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:04.188673 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:04.190115 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:04.202682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fdac6-41e6-4343-a881-6ae7d61793f1 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:04.208426 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:04.209317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:04.209718 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:04.210099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] PATH_INFO: `/v3/projects/4e125d4acd224715a0e59189722efd7f` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:04.212289 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e125d4acd224715a0e59189722efd7f)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:04.219525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:04.284050 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e125d4acd224715a0e59189722efd7f', 'request_id': 'req-702ef9b0-73df-435a-a639-96545f8c4109'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.291491 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e125d4acd224715a0e59189722efd7f', 'request_id': 'req-702ef9b0-73df-435a-a639-96545f8c4109'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.300069 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e125d4acd224715a0e59189722efd7f', 'request_id': 'req-702ef9b0-73df-435a-a639-96545f8c4109'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.314531 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] The token cache is being invalidate because project 4e125d4acd224715a0e59189722efd7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:04.314955 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.315802 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.317830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1426/2827] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:04 2022] DELETE /identity/v3/projects/4e125d4acd224715a0e59189722efd7f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:04.322095 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:04.332488 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e36e88-5fe2-4975-b1da-8f6e8b9f6e78 service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:04.408300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:04.409007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:04.409293 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:04.409568 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] PATH_INFO: `/v3/users/645343c5689a4e12a73980abb03d35f9` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:04.410778 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645343c5689a4e12a73980abb03d35f9)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:04.412741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:04.468803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645343c5689a4e12a73980abb03d35f9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.469491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645343c5689a4e12a73980abb03d35f9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.480806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645343c5689a4e12a73980abb03d35f9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.489973 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645343c5689a4e12a73980abb03d35f9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.490594 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0cf585f9-c7e6-4d3f-b3af-01ace4007789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645343c5689a4e12a73980abb03d35f9'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:04.510110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1402/2828] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:04 2022] DELETE /identity/v3/users/645343c5689a4e12a73980abb03d35f9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:55:04.823702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:04.826915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:04.863164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef9b0-73df-435a-a639-96545f8c4109 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:04.900377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:04.932629 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:04.933608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:04.934093 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:04.934588 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] PATH_INFO: `/v3/projects/ab339d37f9934cbfb79b533056348688` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:04.936554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab339d37f9934cbfb79b533056348688)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:04.940269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.005412 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab339d37f9934cbfb79b533056348688', 'request_id': 'req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:05.013765 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab339d37f9934cbfb79b533056348688', 'request_id': 'req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:05.023621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab339d37f9934cbfb79b533056348688', 'request_id': 'req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:05.035615 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] The token cache is being invalidate because project ab339d37f9934cbfb79b533056348688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:05.035905 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:05.036553 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9d07af7a-783d-42b3-8f2c-8b7b3ba08b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:05.038298 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1427/2829] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:04 2022] DELETE /identity/v3/projects/ab339d37f9934cbfb79b533056348688 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:05.043530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.043928 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.044274 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.065655 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:05.067193 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.148268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1403/2830] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:05.158587 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.158978 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.159170 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.183052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:05.184010 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.192180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1428/2831] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:05.197170 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.207464 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74543da-aa54-49c5-9e33-3d1ffc38e90d None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.213402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.214024 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.214301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.214709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.215263 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:55:05.215737 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.217442 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.237280 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1404/2832] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:55:05.241753 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.252999 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be470d3d-90d1-40b7-8e77-4dde2e0b590b None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.257886 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.258432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.258746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.259536 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.260171 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.262130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.296620 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1429/2833] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:55:05.297799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.307022 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:05.313566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1741d22-6e9b-43bc-b153-7ca2b89db9f1 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.386179 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.386803 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.387083 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.387355 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.388000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.390491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.413533 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1405/2834] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:55:05.418931 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.429548 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2a6d4-3644-427f-a368-b5cb83b6166e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.437207 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.438575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.438927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.439241 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.440148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.441998 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.458121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1430/2835] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:05.459514 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.480006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd461e83-c473-4480-ac98-bc68e005ba63 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.487230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d555cc-1011-4a9a-b963-c5c1831d1398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.487950 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d555cc-1011-4a9a-b963-c5c1831d1398 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.488240 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d555cc-1011-4a9a-b963-c5c1831d1398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.488518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d555cc-1011-4a9a-b963-c5c1831d1398 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.489265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d555cc-1011-4a9a-b963-c5c1831d1398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.491108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d555cc-1011-4a9a-b963-c5c1831d1398 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.504065 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1406/2836] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:05.508224 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.519228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711fdc-ff33-4b53-a37f-ad1cd9abc63c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.524792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.525389 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.525754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.526098 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] PATH_INFO: `/v3/projects/542126686d4b4bb485251d760b98e20a/users/a602e85b0a7940c6a6d6ea04af8f61a1/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.551904 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542126686d4b4bb485251d760b98e20a, user_id=a602e85b0a7940c6a6d6ea04af8f61a1, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.555263 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.577613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1431/2837] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:05 2022] PUT /identity/v3/projects/542126686d4b4bb485251d760b98e20a/users/a602e85b0a7940c6a6d6ea04af8f61a1/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:05.596643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.597775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.598112 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.638306 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] MFA Rules not processed for user `a602e85b0a7940c6a6d6ea04af8f61a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:05.639694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.732592 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1407/2838] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:05.737437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.802510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7b3e-1321-4800-ac3a-90334ca1d2f5 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.807611 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.808221 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.808498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.808803 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.809448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.811351 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.816019 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:05.844222 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1432/2839] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:05.848325 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.860515 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e87243-9c24-4ae5-8b4b-4125bbd30330 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.920028 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.920642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.920955 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.921233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.921881 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.923809 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.941374 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:05.947785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1408/2840] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:05.954040 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.965139 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4f977-dd66-4b30-8b90-8cec83f87b06 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.969842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.970448 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.970725 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.971022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.971668 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.973309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.988920 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1433/2841] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:05.991138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.004098 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb59f-f282-4d7d-acb5-9202dad52173 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.010580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.010939 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.011366 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.011681 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] PATH_INFO: `/v3/projects/f2d42c5a74ba419b83fe662548e0295d/users/b37d4ef800ea4816b3129d19957f78d6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.029005 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d42c5a74ba419b83fe662548e0295d, user_id=b37d4ef800ea4816b3129d19957f78d6, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.031948 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.048517 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1409/2842] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:05 2022] PUT /identity/v3/projects/f2d42c5a74ba419b83fe662548e0295d/users/b37d4ef800ea4816b3129d19957f78d6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:06.052788 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.063402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f24239-a702-4e8d-88c2-9a875ef8ce1e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.127434 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409fd6-7640-4051-8bfb-53c5197eaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.128058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409fd6-7640-4051-8bfb-53c5197eaf0f admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.128341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409fd6-7640-4051-8bfb-53c5197eaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.128646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409fd6-7640-4051-8bfb-53c5197eaf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.129349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409fd6-7640-4051-8bfb-53c5197eaf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.130974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409fd6-7640-4051-8bfb-53c5197eaf0f admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.144769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1434/2843] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:06.147136 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.158352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbca7e5-db98-460c-b4df-2d46266d3145 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.163075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.163725 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.164007 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.164279 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] PATH_INFO: `/v3/projects/f2d42c5a74ba419b83fe662548e0295d/users/b37d4ef800ea4816b3129d19957f78d6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.166299 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d42c5a74ba419b83fe662548e0295d, user_id=b37d4ef800ea4816b3129d19957f78d6, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.169133 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.180658 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1410/2844] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:06 2022] PUT /identity/v3/projects/f2d42c5a74ba419b83fe662548e0295d/users/b37d4ef800ea4816b3129d19957f78d6/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:06.191129 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.191420 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.191698 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.229956 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] MFA Rules not processed for user `b37d4ef800ea4816b3129d19957f78d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:06.231205 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:06.307325 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1435/2845] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:06.320460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.322423 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:06.400602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192d64d-3b9e-4d1d-b48a-9f261f31195a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.404352 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155157e9-2b1d-4005-a6a7-067313521bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.405027 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155157e9-2b1d-4005-a6a7-067313521bfb service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.405301 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155157e9-2b1d-4005-a6a7-067313521bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.405575 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155157e9-2b1d-4005-a6a7-067313521bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.415867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155157e9-2b1d-4005-a6a7-067313521bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.417605 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155157e9-2b1d-4005-a6a7-067313521bfb service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.428016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1411/2846] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:06.506657 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.516812 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e55477-8e1a-4359-aec1-b77f95a8e66f None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.520896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.521507 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.521790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.522056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.579564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:06.584422 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.586370 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.596333 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1436/2847] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:09.943586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ccc4-7b01-48ea-acc0-32b0ba377ae8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:09.944254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ccc4-7b01-48ea-acc0-32b0ba377ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:09.944254 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7ccc4-7b01-48ea-acc0-32b0ba377ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:09.965152 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-cad7ccc4-7b01-48ea-acc0-32b0ba377ae8 None None] MFA Rules not processed for user `9d8b49f3dd9f47c1bc6bda85e76324ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:09.966449 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cad7ccc4-7b01-48ea-acc0-32b0ba377ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:10.052864 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1412/2848] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:12.845697 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:12.939246 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fc681-8c0b-488e-8581-b6c8546bab81 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:12.947034 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:12.947701 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:12.948648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:12.948648 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] PATH_INFO: `/v3/users/a602e85b0a7940c6a6d6ea04af8f61a1` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:12.949580 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a602e85b0a7940c6a6d6ea04af8f61a1)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:12.951598 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:13.031026 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a602e85b0a7940c6a6d6ea04af8f61a1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.031751 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a602e85b0a7940c6a6d6ea04af8f61a1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.045694 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a602e85b0a7940c6a6d6ea04af8f61a1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.047762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a602e85b0a7940c6a6d6ea04af8f61a1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.065374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a602e85b0a7940c6a6d6ea04af8f61a1'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.094498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1437/2849] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:12 2022] DELETE /identity/v3/users/a602e85b0a7940c6a6d6ea04af8f61a1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:13.099375 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:13.099963 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:13.100218 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:13.129460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:13.131184 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:13.220162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1413/2850] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:13.232081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:13.234231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:13.308196 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52d2df-d378-4285-aace-fe1ce60f697c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:13.312398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:13.313057 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:13.313341 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:13.313609 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:13.325831 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:13.327284 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:13.344573 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1438/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:13.740903 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:13.743178 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:13.763967 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:13.861341 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c5030-4e54-4f0e-81f9-63b84016813e None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:13.866952 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:13.867682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:13.868530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:13.868530 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] PATH_INFO: `/v3/projects/542126686d4b4bb485251d760b98e20a` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:13.869641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542126686d4b4bb485251d760b98e20a)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:13.871794 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:13.937750 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542126686d4b4bb485251d760b98e20a', 'request_id': 'req-f7fdcd1e-5064-46d1-9d4f-cc5095083413'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.947402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542126686d4b4bb485251d760b98e20a', 'request_id': 'req-f7fdcd1e-5064-46d1-9d4f-cc5095083413'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.955297 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542126686d4b4bb485251d760b98e20a', 'request_id': 'req-f7fdcd1e-5064-46d1-9d4f-cc5095083413'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.967851 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] The token cache is being invalidate because project 542126686d4b4bb485251d760b98e20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:13.968138 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.968833 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:13.970383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1414/2852] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:13 2022] DELETE /identity/v3/projects/542126686d4b4bb485251d760b98e20a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:13.974589 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:13.998328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:14.043794 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b1f54-bbf4-436a-81a7-f26e277d325d service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:14.137378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:14.138602 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:14.139022 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:14.139382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] PATH_INFO: `/v3/users/b37d4ef800ea4816b3129d19957f78d6` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:14.141007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37d4ef800ea4816b3129d19957f78d6)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:14.143212 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:14.204021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37d4ef800ea4816b3129d19957f78d6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.204685 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37d4ef800ea4816b3129d19957f78d6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.213058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37d4ef800ea4816b3129d19957f78d6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.213927 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37d4ef800ea4816b3129d19957f78d6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.222617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-14d73e40-9eb7-42f8-bf2e-c2932dc48081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37d4ef800ea4816b3129d19957f78d6'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.246964 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1439/2853] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:13 2022] DELETE /identity/v3/users/b37d4ef800ea4816b3129d19957f78d6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:14.571856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:14.573720 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:14.593368 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdcd1e-5064-46d1-9d4f-cc5095083413 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:14.671958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:14.672625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:14.672926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:14.673196 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] PATH_INFO: `/v3/projects/f2d42c5a74ba419b83fe662548e0295d` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:14.674359 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d42c5a74ba419b83fe662548e0295d)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:14.676294 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:14.723888 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:14.741088 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d42c5a74ba419b83fe662548e0295d', 'request_id': 'req-1a71a44d-f551-4b71-8430-7ae20a464e73'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.750821 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d42c5a74ba419b83fe662548e0295d', 'request_id': 'req-1a71a44d-f551-4b71-8430-7ae20a464e73'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.758472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d42c5a74ba419b83fe662548e0295d', 'request_id': 'req-1a71a44d-f551-4b71-8430-7ae20a464e73'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.769806 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] The token cache is being invalidate because project f2d42c5a74ba419b83fe662548e0295d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:14.770099 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.770776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1a71a44d-f551-4b71-8430-7ae20a464e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:14.772275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1415/2854] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:14 2022] DELETE /identity/v3/projects/f2d42c5a74ba419b83fe662548e0295d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:14.779554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:14.779840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:14.780102 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:14.855746 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:14.857044 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:14.897502 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:14.947111 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1440/2855] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:14.956996 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:14.957349 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:14.957540 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:14.984830 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:14.986231 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:14.998455 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1416/2856] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:15.005329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.023776 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280690-e9c7-4b76-9df8-469ddfb01826 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.032086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.033191 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.033702 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.034219 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.035801 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:55:15.036444 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.040292 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.061474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1441/2857] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:55:15.067613 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.079581 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c1e-e8f5-4ab5-b03c-0b184a8facdf None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.084546 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.085335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.085805 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.087163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.087163 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.089265 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.131528 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1417/2858] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:15 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:15.137190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.147836 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9435f0-2e41-4bdc-9223-b9182d6afbef admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.226352 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.227480 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.228038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.228893 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.230080 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.234005 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.267081 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1442/2859] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:15 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:15.268744 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.280508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5756c-57f0-4156-9343-d1de8eb7c80d admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.287863 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.289278 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.290491 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.290972 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.292153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.295571 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.310508 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1418/2860] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:15.316969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.332051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43bc9b-d10a-4a9f-abdb-cf660640ba1c admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.339252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992a06b-ac07-4900-af21-647d1bc03497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.340038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992a06b-ac07-4900-af21-647d1bc03497 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.340273 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992a06b-ac07-4900-af21-647d1bc03497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.340555 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992a06b-ac07-4900-af21-647d1bc03497 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.341253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992a06b-ac07-4900-af21-647d1bc03497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.343121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992a06b-ac07-4900-af21-647d1bc03497 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.360916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1443/2861] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:15.362388 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.377283 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9ff90-fdbe-4c63-91ae-52193341be63 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.382499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.383351 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.383635 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.383918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] PATH_INFO: `/v3/projects/f344d37a773b40b7af330bda45fa1465/users/4100a7b791de4acebcf0656c4381a028/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.404089 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f344d37a773b40b7af330bda45fa1465, user_id=4100a7b791de4acebcf0656c4381a028, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.407220 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.425909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1419/2862] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:15 2022] PUT /identity/v3/projects/f344d37a773b40b7af330bda45fa1465/users/4100a7b791de4acebcf0656c4381a028/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:15.438984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.438984 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.439307 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.474148 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] MFA Rules not processed for user `4100a7b791de4acebcf0656c4381a028`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:15.475417 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:15.564206 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1444/2863] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:15.568784 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.656522 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd2a4-7c59-4774-9173-1479a1d8a8a0 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.661652 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.662282 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.662590 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.662865 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.663555 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.666142 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.700730 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1420/2864] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:15 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:15.707012 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.725130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5608c8-04e5-4fb2-8266-521f19b56fa3 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.755466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.797564 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.798085 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.798366 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.798665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.799311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.801424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.828436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1445/2865] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:15 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:15.832874 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.845409 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9376ec-fb0e-40bb-974c-a843abb343a3 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.850188 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.850914 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.851365 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.851673 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.853371 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.855856 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.870290 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1421/2866] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:15.874882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.885688 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e986e2d-b9e6-4aef-ae1d-89c0a7e4969e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.892051 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.892770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.893058 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.893339 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] PATH_INFO: `/v3/projects/ac33ed34bef54792a65a6cc2a576c1ee/users/6052c5a255594477a7080dd148e88a35/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.916180 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac33ed34bef54792a65a6cc2a576c1ee, user_id=6052c5a255594477a7080dd148e88a35, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.918969 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.936377 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1446/2867] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:15 2022] PUT /identity/v3/projects/ac33ed34bef54792a65a6cc2a576c1ee/users/6052c5a255594477a7080dd148e88a35/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:15.940617 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:15.951625 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416369-d312-4666-b6fa-21769496a111 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.987333 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:16.025781 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46fba1-aa23-4f62-b634-3243f0f8f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:16.026467 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46fba1-aa23-4f62-b634-3243f0f8f57f admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:16.026774 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46fba1-aa23-4f62-b634-3243f0f8f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:16.027042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46fba1-aa23-4f62-b634-3243f0f8f57f admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:16.027758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46fba1-aa23-4f62-b634-3243f0f8f57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:16.029473 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46fba1-aa23-4f62-b634-3243f0f8f57f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:16.041724 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1422/2868] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:16.047038 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:16.064363 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8779318-336e-4593-a9c5-eb4eb85e7110 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:16.069582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:16.070261 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:16.070605 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:16.071208 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] PATH_INFO: `/v3/projects/ac33ed34bef54792a65a6cc2a576c1ee/users/6052c5a255594477a7080dd148e88a35/roles/d7ef9b15eff4469b987c7ef49fc9c9ae` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:16.074915 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac33ed34bef54792a65a6cc2a576c1ee, user_id=6052c5a255594477a7080dd148e88a35, role_id=d7ef9b15eff4469b987c7ef49fc9c9ae)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:16.080418 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:16.094446 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1447/2869] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:16 2022] PUT /identity/v3/projects/ac33ed34bef54792a65a6cc2a576c1ee/users/6052c5a255594477a7080dd148e88a35/roles/d7ef9b15eff4469b987c7ef49fc9c9ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:16.109485 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:16.109897 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:16.110233 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:16.153428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] MFA Rules not processed for user `6052c5a255594477a7080dd148e88a35`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:16.154660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:16.244308 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1423/2870] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:16.257954 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:16.260345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:16.356488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d36d1e-5704-4fd9-974e-c8d419f7f86b admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:16.360269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:16.360944 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:16.361258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:16.361529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:16.372574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:16.374089 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:16.385253 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1448/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:16.491234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:16.502622 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a21a-ef55-4320-8afc-7f065b556037 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:16.506577 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcbd32-1c3f-48d9-a39f-df3a3ffd8b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:16.507199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcbd32-1c3f-48d9-a39f-df3a3ffd8b78 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:16.507483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcbd32-1c3f-48d9-a39f-df3a3ffd8b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:16.507754 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcbd32-1c3f-48d9-a39f-df3a3ffd8b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:16.570694 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcbd32-1c3f-48d9-a39f-df3a3ffd8b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:16.572135 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcbd32-1c3f-48d9-a39f-df3a3ffd8b78 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:16.582148 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1424/2872] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:16.949847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:17.017898 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc892b-903a-4721-98ee-712cd8891bf3 service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:17.022551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:17.023183 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.023465 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.023805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] PATH_INFO: `/v3/users/4100a7b791de4acebcf0656c4381a028` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.025118 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4100a7b791de4acebcf0656c4381a028)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:17.027084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:17.034720 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.083762 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4100a7b791de4acebcf0656c4381a028'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.084535 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4100a7b791de4acebcf0656c4381a028'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.093882 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4100a7b791de4acebcf0656c4381a028'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.094663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4100a7b791de4acebcf0656c4381a028'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.105928 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4100a7b791de4acebcf0656c4381a028'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.133757 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1449/2873] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:16 2022] DELETE /identity/v3/users/4100a7b791de4acebcf0656c4381a028 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:17.138497 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.139051 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.139245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.165997 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:17.167384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:17.246268 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=100 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.262327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1425/2874] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:17.272378 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:17.274460 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:17.334578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b843-ab3c-4ed4-854e-5990324b41e2 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:17.339245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:17.339866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.340150 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.340421 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.353314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:17.357003 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:17.367796 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1450/2875] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:17.676000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:17.677483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:17.690469 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913da538-b677-4554-9321-74d350d3e2d0 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:17.697053 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:17.697743 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.698025 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.698300 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] PATH_INFO: `/v3/projects/f344d37a773b40b7af330bda45fa1465` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.699668 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f344d37a773b40b7af330bda45fa1465)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:17.701717 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:17.759852 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f344d37a773b40b7af330bda45fa1465', 'request_id': 'req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.768630 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f344d37a773b40b7af330bda45fa1465', 'request_id': 'req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.777272 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f344d37a773b40b7af330bda45fa1465', 'request_id': 'req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.788960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] The token cache is being invalidate because project f344d37a773b40b7af330bda45fa1465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:17.789330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.790271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.791802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1426/2876] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:17 2022] DELETE /identity/v3/projects/f344d37a773b40b7af330bda45fa1465 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:17.796608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:17.808266 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb99f7-9600-48b6-9d27-1838d7283d22 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:17.872645 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:17.873342 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.873628 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.873902 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] PATH_INFO: `/v3/users/6052c5a255594477a7080dd148e88a35` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.875143 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6052c5a255594477a7080dd148e88a35)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:17.877153 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:17.921595 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.945021 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6052c5a255594477a7080dd148e88a35'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.946424 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6052c5a255594477a7080dd148e88a35'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.956607 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6052c5a255594477a7080dd148e88a35'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.957488 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6052c5a255594477a7080dd148e88a35'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.967967 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-d601363e-7740-4f41-8a0f-51b69479b550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6052c5a255594477a7080dd148e88a35'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:17.994903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1451/2877] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:17 2022] DELETE /identity/v3/users/6052c5a255594477a7080dd148e88a35 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:18.306391 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.308850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.322500 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9796f8-0cc5-47e5-bc0a-32ec3ee5ff03 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.386350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.386995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.387275 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.387547 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] PATH_INFO: `/v3/projects/ac33ed34bef54792a65a6cc2a576c1ee` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.388685 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac33ed34bef54792a65a6cc2a576c1ee)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.390641 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.442384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac33ed34bef54792a65a6cc2a576c1ee', 'request_id': 'req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.451832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac33ed34bef54792a65a6cc2a576c1ee', 'request_id': 'req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.459329 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac33ed34bef54792a65a6cc2a576c1ee', 'request_id': 'req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.473253 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] The token cache is being invalidate because project ac33ed34bef54792a65a6cc2a576c1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:18.473448 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.474090 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-d0340d7b-ca80-44d1-ae5b-2cdf2fff2651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.475579 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1427/2878] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:18 2022] DELETE /identity/v3/projects/ac33ed34bef54792a65a6cc2a576c1ee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:18.481309 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159526d1-b534-4758-8160-067aabe04bde None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.481842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159526d1-b534-4758-8160-067aabe04bde None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.481979 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159526d1-b534-4758-8160-067aabe04bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.503252 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-159526d1-b534-4758-8160-067aabe04bde None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:18.504474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-159526d1-b534-4758-8160-067aabe04bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.567916 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1452/2879] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:18.577336 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.577621 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.577891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.593765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:18.600330 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:18.602748 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.611893 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1428/2880] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:18.616312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159526d1-b534-4758-8160-067aabe04bde None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.626952 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159526d1-b534-4758-8160-067aabe04bde None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.631705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.632321 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.632621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.632970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.633646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:55:18.633940 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.635562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.649549 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1453/2881] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:55:18.653924 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.663734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb1aa2-ad7b-4ae7-bea8-5dd7988e9e65 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.670591 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.671223 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.671505 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.671785 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.672430 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.674415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.716006 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1429/2882] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:18 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:18.718350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.730323 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254d45-a47f-4dad-b75b-8a41d9108d0e admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.794436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.795063 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.795374 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.795655 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.796281 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.798259 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.829888 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1454/2883] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:18 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:18.830373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.846919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06907e3-9342-4c42-81c2-2ec1459d9c52 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.853081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.853657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.853937 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.854208 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.855206 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.857675 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.872175 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1430/2884] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:18.873847 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.886228 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e944-7844-4d49-a917-4cd9ad6a49d3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.890864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3feb9a7-6dbf-4e3b-ba87-6ed124e86fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.891530 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feb9a7-6dbf-4e3b-ba87-6ed124e86fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.891816 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feb9a7-6dbf-4e3b-ba87-6ed124e86fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.892060 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feb9a7-6dbf-4e3b-ba87-6ed124e86fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.892689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3feb9a7-6dbf-4e3b-ba87-6ed124e86fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.894349 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3feb9a7-6dbf-4e3b-ba87-6ed124e86fd5 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.908554 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1455/2885] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:18.915397 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.925689 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc85dc-9710-4d8a-b35e-fffd989ad3d4 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.931200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.931872 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] REQUEST_METHOD: `PUT` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.932162 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.932438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] PATH_INFO: `/v3/projects/1a67042779ea48988777cf2bb7d51932/users/6961a51685114fa9a58dbcab2942e715/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.949989 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a67042779ea48988777cf2bb7d51932, user_id=6961a51685114fa9a58dbcab2942e715, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.952672 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.967042 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1431/2886] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:18 2022] PUT /identity/v3/projects/1a67042779ea48988777cf2bb7d51932/users/6961a51685114fa9a58dbcab2942e715/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:18.978235 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230b08-02fd-4b2a-9abe-5925d64f4804 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.978518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230b08-02fd-4b2a-9abe-5925d64f4804 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.978789 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47230b08-02fd-4b2a-9abe-5925d64f4804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:19.005086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:19.008498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-47230b08-02fd-4b2a-9abe-5925d64f4804 None None] MFA Rules not processed for user `6961a51685114fa9a58dbcab2942e715`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:19.011314 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-47230b08-02fd-4b2a-9abe-5925d64f4804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:19.079616 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1456/2887] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:19.092032 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:19.093765 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:19.163481 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5040c-81b7-4387-9639-ddd9308e224e admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:19.167246 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:19.167859 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:19.168167 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:19.168445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:19.177428 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:19.178870 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:19.190039 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1432/2888] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:24.492594 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:24.493524 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:24.494382 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:24.545686 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:24.549996 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:24.695937 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1457/2889] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:24.713020 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:24.715558 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:24.961736 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135fdae-38d9-493f-a88b-4ab64d6aed02 service cinder] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:24.969988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b2257-e736-47ba-8bd2-47b1411a5140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:24.970727 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b2257-e736-47ba-8bd2-47b1411a5140 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:24.971092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b2257-e736-47ba-8bd2-47b1411a5140 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:24.971367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b2257-e736-47ba-8bd2-47b1411a5140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:24.981918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b2257-e736-47ba-8bd2-47b1411a5140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:24.983831 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b2257-e736-47ba-8bd2-47b1411a5140 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:24.994958 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1433/2890] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:27.690830 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:27.693539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:27.913312 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847124-57a5-4dcb-9344-cd6eb8f98c11 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:27.920440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:27.921539 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:27.921835 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:27.922105 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:27.924692 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:27.941872 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:27.943815 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:27.958567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1458/2891] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:27.997416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5b3b-0704-4361-9196-2f3bee9450fb None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:27.997416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5b3b-0704-4361-9196-2f3bee9450fb None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:27.997416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5b3b-0704-4361-9196-2f3bee9450fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:28.020412 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:28.045576 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-3fcc5b3b-0704-4361-9196-2f3bee9450fb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:28.047460 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-3fcc5b3b-0704-4361-9196-2f3bee9450fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:28.068761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1434/2892] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:28.089769 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:28.121689 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca5f5c-164a-4ba6-8e80-3cdbcc9ec1d1 service placement] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:28.131466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:28.133173 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:28.134706 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:28.135326 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:28.154164 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:28.157350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:28.167938 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:28.178543 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1459/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:31.039817 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:31.040373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:31.040373 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:31.061335 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:31.062711 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:31.070665 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1435/2894] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:31.088646 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:31.101903 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3adff-82e2-4d30-8868-6899689dee53 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:31.107853 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbab5-9653-4529-a0a7-72034779b160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:31.108474 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbab5-9653-4529-a0a7-72034779b160 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:31.108781 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbab5-9653-4529-a0a7-72034779b160 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:31.109056 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbab5-9653-4529-a0a7-72034779b160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:31.118805 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dbab5-9653-4529-a0a7-72034779b160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:31.120475 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dbab5-9653-4529-a0a7-72034779b160 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:31.131329 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1460/2895] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:31.372185 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:31.383076 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b3af-599f-44a9-beec-d0ff13c3ca93 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:31.388118 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:31.388775 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:31.390346 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:31.390585 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] PATH_INFO: `/v3/users/6961a51685114fa9a58dbcab2942e715` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:31.392026 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6961a51685114fa9a58dbcab2942e715)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:31.394612 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:31.451807 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6961a51685114fa9a58dbcab2942e715'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:31.452386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6961a51685114fa9a58dbcab2942e715'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:31.460172 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6961a51685114fa9a58dbcab2942e715'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:31.470742 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6961a51685114fa9a58dbcab2942e715'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:31.471444 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6961a51685114fa9a58dbcab2942e715'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:31.491437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1436/2896] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:31 2022] DELETE /identity/v3/users/6961a51685114fa9a58dbcab2942e715 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:55:31.496127 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:31.496408 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:31.496681 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:31.519574 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:31.520828 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:31.592957 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1461/2897] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:31.604601 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:31.606075 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:31.670596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20f8a4-cfc8-47a1-a0bb-f02ecf989a61 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:31.674348 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08dc23b-715f-4e60-81ea-24ea8a183d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:31.674964 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dc23b-715f-4e60-81ea-24ea8a183d24 service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:31.675235 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dc23b-715f-4e60-81ea-24ea8a183d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:31.675511 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08dc23b-715f-4e60-81ea-24ea8a183d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:31.686682 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dc23b-715f-4e60-81ea-24ea8a183d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:31.692518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08dc23b-715f-4e60-81ea-24ea8a183d24 service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:31.704081 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1437/2898] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:32.079982 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.081563 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:32.098993 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ea12e-d08b-4df7-9c24-cb1f8a3fd3bb None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.108623 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.109817 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.110095 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.110431 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] PATH_INFO: `/v3/projects/1a67042779ea48988777cf2bb7d51932` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.111665 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a67042779ea48988777cf2bb7d51932)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.114092 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.181705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a67042779ea48988777cf2bb7d51932', 'request_id': 'req-b3676f85-abe3-48a5-9670-6ae5aad7387a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:32.189517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a67042779ea48988777cf2bb7d51932', 'request_id': 'req-b3676f85-abe3-48a5-9670-6ae5aad7387a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:32.200469 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a67042779ea48988777cf2bb7d51932', 'request_id': 'req-b3676f85-abe3-48a5-9670-6ae5aad7387a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:32.216632 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] The token cache is being invalidate because project 1a67042779ea48988777cf2bb7d51932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:32.216910 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:32.217738 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-b3676f85-abe3-48a5-9670-6ae5aad7387a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:32.219499 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1462/2899] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:32 2022] DELETE /identity/v3/projects/1a67042779ea48988777cf2bb7d51932 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:32.228850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.228850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.228850 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.250438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:32.251723 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:32.329757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1438/2900] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:32.338906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.339172 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.339463 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.372840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:32.374215 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:32.388575 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1463/2901] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:32.393417 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.405988 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495bd3c-b04e-44de-b2a5-4bf2ee64aadf None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.410832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.411462 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.411779 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.412085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.413061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:55:32.413260 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.415031 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.416990 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:32.440495 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1439/2902] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:55:32.441618 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.454864 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9cd2-3309-4283-a6e1-affe6ebde4da None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.460332 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.461947 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.462621 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.462975 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.463485 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.474667 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.524797 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1464/2903] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:32 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:32.528923 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.541033 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925099af-3ce7-450f-9a9e-bcd10398451f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.611103 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.611827 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.612108 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.612384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.613082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.615097 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.643880 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1440/2904] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:32 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:32.648839 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.661077 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3cd3-fbe1-4da3-a187-ed0110556f5d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.666567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.667199 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.667482 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.667759 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.668596 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.670276 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.682795 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1465/2905] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:32.687878 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.701749 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b6811-9c74-4a09-8906-d0afcc4f9cf5 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.707044 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ef7f7-daad-4379-8048-18b4eca98565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.707703 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ef7f7-daad-4379-8048-18b4eca98565 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.707986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ef7f7-daad-4379-8048-18b4eca98565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.708296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ef7f7-daad-4379-8048-18b4eca98565 admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.708986 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ef7f7-daad-4379-8048-18b4eca98565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.711362 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ef7f7-daad-4379-8048-18b4eca98565 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.735602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1441/2906] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:32.738101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.752328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd54bec-f2b1-4736-9fd6-d947f30dafb3 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:32.758601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:32.759525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.759908 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.760229 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] PATH_INFO: `/v3/projects/dad82f3c111f4f1eaf3d626cc0fb3ab3/users/6b96725a4b454694b7d930a8017e0866/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.778436 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad82f3c111f4f1eaf3d626cc0fb3ab3, user_id=6b96725a4b454694b7d930a8017e0866, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:32.781517 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:32.798277 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1466/2907] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:32 2022] PUT /identity/v3/projects/dad82f3c111f4f1eaf3d626cc0fb3ab3/users/6b96725a4b454694b7d930a8017e0866/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:55:32.807067 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7d67-3650-4d5a-b91e-42e43c1a4c47 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.807186 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7d67-3650-4d5a-b91e-42e43c1a4c47 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.807432 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7d67-3650-4d5a-b91e-42e43c1a4c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.829978 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8c4e7d67-3650-4d5a-b91e-42e43c1a4c47 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:32.831230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8c4e7d67-3650-4d5a-b91e-42e43c1a4c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:32.911251 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1442/2908] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:32.929525 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.931782 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:32.946617 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:33.039723 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a24649-c9b9-4795-b3f3-966e15d8a347 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:33.043662 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:33.044320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:33.044600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:33.044907 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:33.055052 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:33.056529 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:33.068264 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1467/2909] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:34.013559 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f0e2-57ef-4be9-b243-9697c3be5e9b None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:34.014917 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f0e2-57ef-4be9-b243-9697c3be5e9b None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:34.015631 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7f0e2-57ef-4be9-b243-9697c3be5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:34.063940 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-e7b7f0e2-57ef-4be9-b243-9697c3be5e9b None None] MFA Rules not processed for user `6b96725a4b454694b7d930a8017e0866`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:34.066245 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-e7b7f0e2-57ef-4be9-b243-9697c3be5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:34.170684 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1443/2910] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:34.185079 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:34.187202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:34.282309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76b66-8e8c-48ac-ac71-6f578644f6c7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:34.282682 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094ef8f-8f14-4e8e-94f8-1c777f7e4869 service neutron] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:34.282866 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76b66-8e8c-48ac-ac71-6f578644f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:34.283259 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76b66-8e8c-48ac-ac71-6f578644f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:34.287101 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:34.288007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:34.288386 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:34.289013 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:34.294919 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:34.303754 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:34.306971 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:34.319415 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-41d76b66-8e8c-48ac-ac71-6f578644f6c7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:34.323741 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-41d76b66-8e8c-48ac-ac71-6f578644f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:34.325732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1468/2911] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:34.335304 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1444/2912] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:34.353833 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:34.356071 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:34.391518 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f61c-89bc-4162-90f0-591d705117ef None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:34.392433 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f61c-89bc-4162-90f0-591d705117ef None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:34.393367 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f61c-89bc-4162-90f0-591d705117ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:34.461886 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-8f45f61c-89bc-4162-90f0-591d705117ef None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:34.464421 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-8f45f61c-89bc-4162-90f0-591d705117ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:34.486779 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fabe2-8eac-49fb-87e6-4c3181a612ab service cinder] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:34.502970 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:34.504347 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:34.504974 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:34.506749 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:34.529518 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:34.533068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:34.550367 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1469/2913] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:34.571554 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1445/2914] 10.222.0.45 () {58 vars in 967 bytes} [Tue Oct 4 08:55:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:34.648190 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:34.650638 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:34.687369 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=100 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:34.777245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccf308-a105-45ad-a7b9-a88779667462 service nova] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:34.778245 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0d44-0ee7-4b0d-b941-585ac9006795 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:34.780145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0d44-0ee7-4b0d-b941-585ac9006795 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:34.780145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0d44-0ee7-4b0d-b941-585ac9006795 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:34.780145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0d44-0ee7-4b0d-b941-585ac9006795 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:34.789107 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0d44-0ee7-4b0d-b941-585ac9006795 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:34.790922 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0d44-0ee7-4b0d-b941-585ac9006795 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:34.801851 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1470/2915] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:55:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:55:35.869758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:35.870328 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:35.870802 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:35.906386 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] MFA Rules not processed for user `6b96725a4b454694b7d930a8017e0866`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:35.909127 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:35.922697 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1446/2916] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:39.708551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:39.709112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:39.709210 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:39.748248 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:39.749561 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:39.759770 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1471/2917] 10.222.0.13 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:55:39.775915 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:39.778128 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:39.801121 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc38d2-2b40-4d16-9606-5b50dee807c8 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:39.807921 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464a6f0e27d642efb036de9164eeefc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:39.808884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:39.809158 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:39.809633 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:39.819884 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:39.822369 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:39.834767 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1447/2918] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:44.146987 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:44.148739 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:44.163733 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c198-18bc-43d3-99a5-f68f01a429ed None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:44.169099 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:44.170551 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:44.171249 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:44.171410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] PATH_INFO: `/v3/users/19caf7c7cc1b4c74a4e5b73e61a2bf07` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:44.172601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19caf7c7cc1b4c74a4e5b73e61a2bf07)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:44.174790 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:44.236945 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19caf7c7cc1b4c74a4e5b73e61a2bf07'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.237663 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19caf7c7cc1b4c74a4e5b73e61a2bf07'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.246258 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19caf7c7cc1b4c74a4e5b73e61a2bf07'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.247007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19caf7c7cc1b4c74a4e5b73e61a2bf07'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.255923 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19caf7c7cc1b4c74a4e5b73e61a2bf07'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.279523 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1472/2919] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:44 2022] DELETE /identity/v3/users/19caf7c7cc1b4c74a4e5b73e61a2bf07 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:44.544209 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:44.574199 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2d377-d66f-405e-bee4-6a91c607fe58 service nova] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:44.679387 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:44.681602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:44.681602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:44.681602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] PATH_INFO: `/v3/projects/fb561461347d4c789911696e8686350d` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:44.683566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb561461347d4c789911696e8686350d)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:44.686904 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:44.790660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb561461347d4c789911696e8686350d', 'request_id': 'req-f73fe9c2-af6e-4b14-bb8f-34b642f91211'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.815483 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb561461347d4c789911696e8686350d', 'request_id': 'req-f73fe9c2-af6e-4b14-bb8f-34b642f91211'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.857173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb561461347d4c789911696e8686350d', 'request_id': 'req-f73fe9c2-af6e-4b14-bb8f-34b642f91211'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.900954 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] The token cache is being invalidate because project fb561461347d4c789911696e8686350d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:44.901350 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.902643 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:44.913984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1448/2920] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:44 2022] DELETE /identity/v3/projects/fb561461347d4c789911696e8686350d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:44.917278 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:44.919792 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:44.948633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a39f-dff7-49a7-b822-569027910729 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:45.065492 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:45.066479 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:45.066919 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:45.067317 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] PATH_INFO: `/v3/users/8a90dbee17d347c5bce28b88715cb88a` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:45.069214 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a90dbee17d347c5bce28b88715cb88a)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:45.073182 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:45.093405 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:45.148279 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a90dbee17d347c5bce28b88715cb88a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.149350 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a90dbee17d347c5bce28b88715cb88a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.158145 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a90dbee17d347c5bce28b88715cb88a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.158778 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a90dbee17d347c5bce28b88715cb88a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.169906 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-7d161cde-8602-4be3-90d7-559132a16401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a90dbee17d347c5bce28b88715cb88a'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.192037 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1473/2921] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:44 2022] DELETE /identity/v3/users/8a90dbee17d347c5bce28b88715cb88a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:45.484271 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:45.487082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:45.508758 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:45.519173 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe9c2-af6e-4b14-bb8f-34b642f91211 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:45.616016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:45.617050 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:45.617383 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:45.617660 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] PATH_INFO: `/v3/projects/c31f3102e2f04ade83ba2ef48e2f5b77` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:45.618970 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31f3102e2f04ade83ba2ef48e2f5b77)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:45.620960 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:45.678252 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31f3102e2f04ade83ba2ef48e2f5b77', 'request_id': 'req-0fe31657-ded3-4489-975d-cd686b3a8307'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.688055 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31f3102e2f04ade83ba2ef48e2f5b77', 'request_id': 'req-0fe31657-ded3-4489-975d-cd686b3a8307'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.696358 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31f3102e2f04ade83ba2ef48e2f5b77', 'request_id': 'req-0fe31657-ded3-4489-975d-cd686b3a8307'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.708437 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] The token cache is being invalidate because project c31f3102e2f04ade83ba2ef48e2f5b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:45.708757 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.709438 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:45.711498 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1449/2922] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:45 2022] DELETE /identity/v3/projects/c31f3102e2f04ade83ba2ef48e2f5b77 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:54.184608 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:54.185320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:54.185320 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:54.207565 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] MFA Rules not processed for user `6b96725a4b454694b7d930a8017e0866`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:54.208968 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:54.284088 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1474/2923] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:55:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:55.704734 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:04.277072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=46,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:09.388247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:09.389910 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:09.472984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31657-ded3-4489-975d-cd686b3a8307 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:09.478296 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:09.478942 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:09.479225 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:09.479499 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] PATH_INFO: `/v3/users/9d8b49f3dd9f47c1bc6bda85e76324ff` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:09.480709 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8b49f3dd9f47c1bc6bda85e76324ff)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:09.482719 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:09.536085 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8b49f3dd9f47c1bc6bda85e76324ff'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.537860 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8b49f3dd9f47c1bc6bda85e76324ff'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.545792 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8b49f3dd9f47c1bc6bda85e76324ff'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.554761 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8b49f3dd9f47c1bc6bda85e76324ff'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.555376 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-1332fc43-9a5e-4cf9-8555-dea6d2458857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8b49f3dd9f47c1bc6bda85e76324ff'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.577000 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1450/2924] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:56:09 2022] DELETE /identity/v3/users/9d8b49f3dd9f47c1bc6bda85e76324ff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:09.795700 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:09.828189 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885649a7-9e27-4b18-b6a7-10d0c94189b2 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:09.911315 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:09.912735 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:09.913440 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:09.913875 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] PATH_INFO: `/v3/projects/64b8dc36ed2c41b0a4457dc795aa772e` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:09.915432 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b8dc36ed2c41b0a4457dc795aa772e)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:09.917466 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:09.982439 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b8dc36ed2c41b0a4457dc795aa772e', 'request_id': 'req-9cad01bb-24af-4a79-96f2-76cc6ff0760d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.989084 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b8dc36ed2c41b0a4457dc795aa772e', 'request_id': 'req-9cad01bb-24af-4a79-96f2-76cc6ff0760d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:09.999510 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b8dc36ed2c41b0a4457dc795aa772e', 'request_id': 'req-9cad01bb-24af-4a79-96f2-76cc6ff0760d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:10.012981 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] The token cache is being invalidate because project 64b8dc36ed2c41b0a4457dc795aa772e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:56:10.013330 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:10.014059 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:10.015600 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1475/2925] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:56:09 2022] DELETE /identity/v3/projects/64b8dc36ed2c41b0a4457dc795aa772e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:10.751327 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761aaa-bc02-4ea9-85a3-261c2cc2a3f0 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:10.751828 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761aaa-bc02-4ea9-85a3-261c2cc2a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:10.752092 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761aaa-bc02-4ea9-85a3-261c2cc2a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:10.773766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-42761aaa-bc02-4ea9-85a3-261c2cc2a3f0 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:10.774995 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-42761aaa-bc02-4ea9-85a3-261c2cc2a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:10.833454 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1451/2926] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Oct 4 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:10.845866 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:10.847344 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:10.924666 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad01bb-24af-4a79-96f2-76cc6ff0760d admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:10.930345 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:10.931029 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:10.931311 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:10.931582 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:10.940800 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:10.942410 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:10.951023 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1476/2927] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:56:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:20.826832 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:20.947483 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:27.523418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:27.523949 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:27.524061 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:27.543599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] MFA Rules not processed for user `bd166217fb89462a9ceb7aade51c4188`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:27.544854 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:27.551981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1452/2928] 10.222.0.45 () {58 vars in 967 bytes} [Tue Oct 4 08:56:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:27.564613 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:27.575497 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163605-10ad-4280-acd1-ca7aa95dd779 service swift] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:27.580498 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763cd7c148d24a679cc2a51a4edfcfa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:27.581121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:27.581402 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:27.581671 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:27.590626 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:27.592202 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:27.600705 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1477/2929] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Oct 4 08:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:29.522804 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:29.524281 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:29.594891 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909ebe-2670-48e8-a2bf-6ca809977496 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:29.599648 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:29.601131 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:29.601443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:29.601766 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] PATH_INFO: `/v3/users/6b96725a4b454694b7d930a8017e0866` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:29.602918 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b96725a4b454694b7d930a8017e0866)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:29.604871 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:29.650586 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b96725a4b454694b7d930a8017e0866'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.651238 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b96725a4b454694b7d930a8017e0866'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.658408 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b96725a4b454694b7d930a8017e0866'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.666566 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b96725a4b454694b7d930a8017e0866'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.667230 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-28edf549-d705-4aa6-a43f-d68bb6de69fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b96725a4b454694b7d930a8017e0866'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.684427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1453/2930] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:56:29 2022] DELETE /identity/v3/users/6b96725a4b454694b7d930a8017e0866 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:56:29.857437 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:29.870185 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fbb0-af1a-4d7e-a43e-ed16144a8f21 service swift] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:29.928808 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:29.929443 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:29.929721 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:29.929995 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] PATH_INFO: `/v3/projects/dad82f3c111f4f1eaf3d626cc0fb3ab3` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:29.931116 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad82f3c111f4f1eaf3d626cc0fb3ab3)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:29.933049 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:29.981296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad82f3c111f4f1eaf3d626cc0fb3ab3', 'request_id': 'req-781c5767-158d-48da-af1d-746ee5ab4f9d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.987467 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad82f3c111f4f1eaf3d626cc0fb3ab3', 'request_id': 'req-781c5767-158d-48da-af1d-746ee5ab4f9d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:29.995844 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad82f3c111f4f1eaf3d626cc0fb3ab3', 'request_id': 'req-781c5767-158d-48da-af1d-746ee5ab4f9d'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.006394 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] The token cache is being invalidate because project dad82f3c111f4f1eaf3d626cc0fb3ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:56:30.006680 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.007296 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-781c5767-158d-48da-af1d-746ee5ab4f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.008861 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1478/2931] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:56:29 2022] DELETE /identity/v3/projects/dad82f3c111f4f1eaf3d626cc0fb3ab3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:30.013862 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.014200 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.014532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.034035 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:30.035234 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:30.098008 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1454/2932] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:30.106413 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.106624 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.106899 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.129484 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:30.130710 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:30.139036 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1479/2933] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:56:30.143445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.153276 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba5db-b039-4bb5-9edf-3ff1e1776da7 None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.157926 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.158650 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.158799 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.159078 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.159762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:56:30.160107 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.161714 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.171981 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:30.175755 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1455/2934] 10.222.0.45 () {58 vars in 1153 bytes} [Tue Oct 4 08:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:56:30.181014 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.190295 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c7ec5-92d0-4bc9-825c-e644af07d680 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.195768 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.196360 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.196637 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.196939 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] PATH_INFO: `/v3/projects` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.197562 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.199459 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.227075 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1480/2935] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:56:30.231202 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.241472 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66003-cd20-4e1f-af0f-6cf6ca5ccaa7 admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.299911 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.300532 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.300840 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.301117 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] PATH_INFO: `/v3/users` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.301756 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.304427 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.326984 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1456/2936] 10.222.0.45 () {60 vars in 1144 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:56:30.331225 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.342840 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0647a4-bd4c-4094-8666-055568f0c649 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.347452 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.348072 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.348356 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.348660 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.349328 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.351086 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.361634 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1481/2937] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:30.366239 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.376082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce479ac-b05a-4f4a-bdd0-62f4cebb190f admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.380599 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b02ee-1a7c-4d30-aee9-4f15225eafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.381834 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b02ee-1a7c-4d30-aee9-4f15225eafcd admin admin] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.382114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b02ee-1a7c-4d30-aee9-4f15225eafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.382384 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b02ee-1a7c-4d30-aee9-4f15225eafcd admin admin] PATH_INFO: `/v3/roles` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.383016 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b02ee-1a7c-4d30-aee9-4f15225eafcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.384602 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b02ee-1a7c-4d30-aee9-4f15225eafcd admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.395145 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1457/2938] 10.222.0.45 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:30.399601 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.409508 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a365e-33fe-408a-b67b-6a569387aa44 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.414197 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.414842 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] REQUEST_METHOD: `PUT` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.415121 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.415490 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] PATH_INFO: `/v3/projects/6ff5e9eb97f941b88e5dba47821b8938/users/86619657f40145a98a258b636f2eaef3/roles/d92f4eb019b54a4183aaf372d9a066ab` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.431269 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff5e9eb97f941b88e5dba47821b8938, user_id=86619657f40145a98a258b636f2eaef3, role_id=d92f4eb019b54a4183aaf372d9a066ab)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.434011 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.446946 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1482/2939] 10.222.0.45 () {60 vars in 1483 bytes} [Tue Oct 4 08:56:30 2022] PUT /identity/v3/projects/6ff5e9eb97f941b88e5dba47821b8938/users/86619657f40145a98a258b636f2eaef3/roles/d92f4eb019b54a4183aaf372d9a066ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:30.458126 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] REQUEST_METHOD: `POST` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.458416 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.458695 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.494114 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.auth.core [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] MFA Rules not processed for user `86619657f40145a98a258b636f2eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=88072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:30.495445 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:30.565510 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1458/2940] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:30.576948 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.578633 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:30.598125 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:30.661643 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ba85-d683-4ae0-8a9d-da166014d775 admin admin] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.666007 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a83c8-4bd0-4761-9697-533d6d952db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '511d91463bbf43ef878a3111e4c11b73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.666614 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a83c8-4bd0-4761-9697-533d6d952db1 service cinder] REQUEST_METHOD: `GET` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.666889 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a83c8-4bd0-4761-9697-533d6d952db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.667156 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a83c8-4bd0-4761-9697-533d6d952db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.675398 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a83c8-4bd0-4761-9697-533d6d952db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.676863 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a83c8-4bd0-4761-9697-533d6d952db1 service cinder] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.685567 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1483/2941] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:40.562614 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:40.681732 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=29 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:40.942776 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:41.006657 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf114597-c21c-46d8-90d8-d11a63d9537f None None] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:41.011443 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:41.012082 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:41.012816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:41.012816 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] PATH_INFO: `/v3/users/86619657f40145a98a258b636f2eaef3` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:41.013762 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86619657f40145a98a258b636f2eaef3)` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:41.015692 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:41.066596 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86619657f40145a98a258b636f2eaef3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.067247 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86619657f40145a98a258b636f2eaef3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.074418 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86619657f40145a98a258b636f2eaef3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.081867 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86619657f40145a98a258b636f2eaef3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.082504 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.notifications [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86619657f40145a98a258b636f2eaef3'} {{(pid=88072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.101153 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1459/2942] 10.222.0.45 () {58 vars in 1224 bytes} [Tue Oct 4 08:56:40 2022] DELETE /identity/v3/users/86619657f40145a98a258b636f2eaef3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:41.106550 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] REQUEST_METHOD: `POST` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:41.106834 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:41.107112 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:41.134028 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.auth.core [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] MFA Rules not processed for user `40a865d2e94a43c8bfaeecc4686bed18`. Rule list: `[]` (Enabled: `True`). {{(pid=88071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:41.135231 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:41.193578 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1484/2943] 10.222.0.45 () {58 vars in 958 bytes} [Tue Oct 4 08:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:41.203642 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:41.205100 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:41.263414 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a8d79-3e27-41b2-9c91-e2522a6aa11a admin admin] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:41.267402 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b448cdeede24aa9bb0fc1a9f210b53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:41.268010 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:41.268284 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:41.268550 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:41.278824 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:41.280332 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:41.291909 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1460/2944] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:41.562355 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] Authenticating user token {{(pid=88071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:41.564006 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.fernet_utils [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:41.578068 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630fa7c-33a5-4c4c-9b82-3d4ce49119c4 None None] Validating token access rules against request {{(pid=88071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:41.584083 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40a865d2e94a43c8bfaeecc4686bed18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c95175d6f124287a997d11bfc5d0ce9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:41.584896 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:41.585403 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:41.585819 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] PATH_INFO: `/v3/projects/6ff5e9eb97f941b88e5dba47821b8938` {{(pid=88071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:41.588579 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff5e9eb97f941b88e5dba47821b8938)` {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:41.590659 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] RBAC: Authorization granted {{(pid=88071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:41.640493 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff5e9eb97f941b88e5dba47821b8938', 'request_id': 'req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.646986 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff5e9eb97f941b88e5dba47821b8938', 'request_id': 'req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.654267 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff5e9eb97f941b88e5dba47821b8938', 'request_id': 'req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0'} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.664630 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] The token cache is being invalidate because project 6ff5e9eb97f941b88e5dba47821b8938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:56:41.664949 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.665652 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG keystone.notifications [None req-ab5e44b2-61a6-43d1-a8e9-468d72a820c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:41.667130 dv-cinder-860212-1-smb devstack@keystone.service[88071]: [pid: 88071|app: 0|req: 1485/2945] 10.222.0.45 () {58 vars in 1233 bytes} [Tue Oct 4 08:56:41 2022] DELETE /identity/v3/projects/6ff5e9eb97f941b88e5dba47821b8938 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:51.287160 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:51.661679 dv-cinder-860212-1-smb devstack@keystone.service[88071]: DEBUG dbcounter [-] [88071] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:28.169768 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] Authenticating user token {{(pid=88072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:00:28.171166 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:28.243674 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9688-f360-48ea-82c1-3e0aab60062f service neutron] Validating token access rules against request {{(pid=88072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:00:28.303309 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c882c87fe9e04430a9c453c761e55927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8b3bf547a824c5ba023710b2a46dad5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:00:28.304018 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] REQUEST_METHOD: `GET` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:28.304305 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] SCRIPT_NAME: `/identity` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:28.304580 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:28.306342 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.fernet_utils [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:28.317531 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:00:28.319110 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dce615-e472-4ed9-b274-50d2b9538214 service placement] RBAC: Authorization granted {{(pid=88072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:00:28.328957 dv-cinder-860212-1-smb devstack@keystone.service[88072]: [pid: 88072|app: 0|req: 1461/2946] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Oct 4 09:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:00:38.324836 dv-cinder-860212-1-smb devstack@keystone.service[88072]: DEBUG dbcounter [-] [88072] Writing DB stats keystone:SELECT=58 {{(pid=88072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}